-- Logs begin at Wed 2022-07-20 21:08:34 UTC, end at Wed 2022-07-20 22:26:46 UTC. -- Jul 20 21:48:29.816062 dv-cinder-849690-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 20 21:48:29.825774 dv-cinder-849690-5-smb devstack@keystone.service[80410]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 20 21:48:29 2022] *** Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: nodename: dv-cinder-849690-5-smb Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: machine: x86_64 Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: clock source: unix Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: pcre jit disabled Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: detected number of CPU cores: 4 Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: current working directory: / Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: detected binary path: /usr/bin/uwsgi-core Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: your processes number limit is 47680 Jul 20 21:48:29.827775 dv-cinder-849690-5-smb devstack@keystone.service[80410]: your memory page size is 4096 bytes Jul 20 21:48:29.829903 dv-cinder-849690-5-smb devstack@keystone.service[80410]: detected max file descriptor number: 2048 Jul 20 21:48:29.829903 dv-cinder-849690-5-smb devstack@keystone.service[80410]: lock engine: pthread robust mutexes Jul 20 21:48:29.829903 dv-cinder-849690-5-smb devstack@keystone.service[80410]: thunder lock: enabled Jul 20 21:48:29.829903 dv-cinder-849690-5-smb devstack@keystone.service[80410]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 20 21:48:29.829903 dv-cinder-849690-5-smb devstack@keystone.service[80410]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 20 21:48:29.871702 dv-cinder-849690-5-smb devstack@keystone.service[80410]: Python main interpreter initialized at 0x55e5f825f9c0 Jul 20 21:48:29.871702 dv-cinder-849690-5-smb devstack@keystone.service[80410]: python threads support enabled Jul 20 21:48:29.871702 dv-cinder-849690-5-smb devstack@keystone.service[80410]: your server socket listen backlog is limited to 100 connections Jul 20 21:48:29.871702 dv-cinder-849690-5-smb devstack@keystone.service[80410]: your mercy for graceful operations on workers is 90 seconds Jul 20 21:48:29.872084 dv-cinder-849690-5-smb devstack@keystone.service[80410]: mapped 403077 bytes (393 KB) for 2 cores Jul 20 21:48:29.872164 dv-cinder-849690-5-smb devstack@keystone.service[80410]: *** Operational MODE: preforking *** Jul 20 21:48:29.872397 dv-cinder-849690-5-smb devstack@keystone.service[80410]: *** uWSGI is running in multiple interpreter mode *** Jul 20 21:48:29.872397 dv-cinder-849690-5-smb devstack@keystone.service[80410]: spawned uWSGI master process (pid: 80410) Jul 20 21:48:29.872592 dv-cinder-849690-5-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 20 21:48:29.873205 dv-cinder-849690-5-smb devstack@keystone.service[80410]: spawned uWSGI worker 1 (pid: 80418, cores: 1) Jul 20 21:48:29.873536 dv-cinder-849690-5-smb devstack@keystone.service[80410]: spawned uWSGI worker 2 (pid: 80419, cores: 1) Jul 20 21:48:29.876250 dv-cinder-849690-5-smb devstack@keystone.service[80410]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 20 21:48:35.403809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:48:35.403809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: from cryptography.utils import int_from_bytes Jul 20 21:48:35.404651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:48:35.404651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: from cryptography.utils import int_from_bytes Jul 20 21:48:35.442781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:48:35.442781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: from cryptography.utils import int_from_bytes Jul 20 21:48:35.443311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 20 21:48:35.443311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: from cryptography.utils import int_from_bytes Jul 20 21:48:35.457995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 21:48:35.458218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 21:48:35.458430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] command line args: [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 21:48:35.458719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 21:48:35.458919 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ================================================================================ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 21:48:35.459320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] admin_token = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.459570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_dir = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.459759 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.459966 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_source = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.460154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] debug = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.460355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.460710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.460887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.461463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.461463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.461617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.461764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_config_append = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.461941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.462117 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_dir = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.462292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.462524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.462768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.463010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.463250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.463425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.463599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.463840 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.464105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.464337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.464566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.464794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.465023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.465265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.465506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.465775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.466265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.85/identity {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.466452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] publish_errors = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.466691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.466923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.467102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.467348 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.467580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.467813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] standard_threads = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.468070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.468447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.468718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.468904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_journal = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.469082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_json = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.469259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_stderr = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.469434 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_syslog = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.469668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.469927 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.470165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.470423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.470664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.470912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.471149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.471396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.471634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.471880 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.472157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.472405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.472639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.472884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.473120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.473365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.473610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.473843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.474094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.474341 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.474586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.474819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.475069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.475326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.475577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.475822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.476073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.476304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.476533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.477067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.477067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.477250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.477462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.477691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.477935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.478181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.478416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.478668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.478897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.479131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.479361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.479590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.479819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.480069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.480298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.480534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.480777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.481005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.481238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.481464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.481698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.481932 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.482174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.482401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.482635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.482869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.483101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.483333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.483565 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.483789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.484621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.484809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.485043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.485270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.485523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.485757 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.485985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.486217 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.486449 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.486712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.486946 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.487190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.487431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.487666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.487900 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.488158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.488403 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.488637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.488870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.489108 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.489340 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.489572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.489806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.490038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.490270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.490534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.490775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.490936 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 20 21:48:35.491019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.491096 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 20 21:48:35.491236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.491315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] command line args: [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 20 21:48:35.491475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.491562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 20 21:48:35.491674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ================================================================================ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 20 21:48:35.491752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.491951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.492031 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] admin_token = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.492188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.492280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] config_dir = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.492416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.492495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.492620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] config_source = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.492705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.492817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] debug = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.492903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.493054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.493162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.493297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.493382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.493508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.493584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.493756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.493833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.493999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.494086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.494233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.494310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.494460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_config_append = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.494537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.494665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.494751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.494857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_dir = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.494938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.495033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.495167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.external = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.495290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.495397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.495556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.495686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.495879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.496028 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.496140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.password = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.496255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.496357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.496455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.token = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.496564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.496672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.496785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.496912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.497047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.497126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.497275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.497357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.497518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.497600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.497761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.497842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.497993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.498074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.498229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.498348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.498472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.498635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.498720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.498937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.499019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.499169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.499408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.499568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.85/identity {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.500522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] publish_errors = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.500620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.500764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.500893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.500970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.501119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.501207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.501342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.501425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.501631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.501711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.501874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.501952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.502134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.502214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] standard_threads = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.502377 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.502461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.502631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.502710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.502866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.502946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.503097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] use_journal = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.503180 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.503311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] use_json = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.503397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.503517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] use_stderr = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.503598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.503732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] use_syslog = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.503812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.504033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 20 21:48:35.504127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.504277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.504351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.504514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.504599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.504750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.504945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.505039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.505189 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.505279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.505436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.505522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.505679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.505758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.505922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.506009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.506162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.506240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.506396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.506489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.506631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.506723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.506891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.506993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.507131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.507209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.507383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.507464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.507626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.507708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.507877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.507988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.508157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.508238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.508386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.508463 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.508618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.508698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.508864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.508944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.509110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.509194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.509356 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.509434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.509607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.509688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.509852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.509939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.510111 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.510195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.510345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.510424 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.510582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.510661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.510815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.510915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.511049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.511128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.511279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.511356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.511515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.511598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.511752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.511849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.512009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.512088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.512247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.512326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.512474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.512554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.512721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.512805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.512959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.513051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.513192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.513320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.513425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.513502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.513666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.513746 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.513896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.513975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.514127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.514213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.514352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.514431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.514584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.514668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.514814 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.514894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.515052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.515402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.515571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.515812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.516006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.516150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.516241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.516317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.516458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.516539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.516690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.516771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.516920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.517000 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.517167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.517247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.517412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.517509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.517650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.517730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.517887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.517967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.518123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.518207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.518357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.518437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.518594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.518769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.518846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.518934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.519066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.519147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.519307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.519396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.519548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.519630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.519789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.519868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.520048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.520132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.520278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.520360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.520516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.520597 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.520752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.520831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.520986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.521067 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.521217 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.521297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.521464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.521543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.521714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.521794 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.521959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.522037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.522203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.522282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.522445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.522531 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.522673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.522752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.522918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.523009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.523155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.523234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.523389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.523468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.523625 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.523714 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.523865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.523993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.524122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.524203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.524364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.524457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.524602 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.524682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.524838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.524918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.525099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.525188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.525340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.525422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.525574 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.525654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.525810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.525898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.526044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.526128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.526282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.526360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.526519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.526605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.526752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.526831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.526984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.527062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.527219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.527306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.527458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.527538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.527699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.527778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.527977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.528072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.528192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.528271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.528430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.528516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.528669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.528766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.528907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.528987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.529139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.529217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.529374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.529465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.529611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.529693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.529855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.529936 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.external = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.530083 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.530171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.530329 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.530409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.530573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.530654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.530859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.password = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.530946 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.531252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.531331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] auth.token = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.531502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.531661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.531740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.531939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.532045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.532196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.532300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.532436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.532516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.532690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.532779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.532932 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.533011 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.533166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.533244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.533408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.533494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.533658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.533807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.533917 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.534041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.534169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.534289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.534410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.534535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.534657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.534779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.534897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.535028 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.535163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.535263 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.535420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.535509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.535671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.535751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.535964 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.536048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.536225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.536328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.536458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.536538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.536688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.536803 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.536935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.537038 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.537188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.537268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.537426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.537505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.537660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.537753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.537896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.537976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.538128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.538207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.538364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.538453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.538596 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.538674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.538841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.538920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.539075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.539163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.539319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.539398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.539560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.539652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.539794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.539882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.540058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.540139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.540299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.540378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.540544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.540635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.540776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.540856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.541010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.541089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.541243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.541397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.541488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.541565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.541711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.541790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.541936 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.542023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.542186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.542291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.542472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.542550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.542727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.542820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.542968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.543049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.543211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.543290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.543444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.543523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.543684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.543764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.543965 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.544049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.544169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.544249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.544402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.544483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.544634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.544714 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.544875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.544954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.545107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.545187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.545347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.545427 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.545580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.545665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.545823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.545903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.546053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.546146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.546291 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.546890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.547034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.547222 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.547389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.547489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.547658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 21:48:35.547736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.547986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.548253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.548512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.548758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.549014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.549270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.549509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.549754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.549991 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.550234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.550476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.550722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.550965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.551205 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.551460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.551721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.551979 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.552219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.552473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.552725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.552969 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.553212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.553454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.553690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.553933 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.554196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.554438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.554757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.555621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.555621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.555621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.555621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.555889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.556114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.556355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.556592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.556844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.557093 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.557345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.557594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.557844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.558079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.558330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.558572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.558812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.559054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.559293 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.559541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.559793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.560058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.560318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.560553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.560802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.561042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.561282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.561522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.561772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.562079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.562483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.562853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.563103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.563362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.563617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.563858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.564138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.564400 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.564644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.564895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.565136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.565387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.565632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] role.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.565884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] role.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.566121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.566372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.566625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.566875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.567125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.567376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.567626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.567883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.568161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.568396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.568648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.568899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.569149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.569397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.569812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.570052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.570305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.570556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.570807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.571072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.571311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.571567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.571822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.572090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.572329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.572566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.572801 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.573056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.573314 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.573565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.573810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.574048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.574286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.574528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.574768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.575018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.575259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.575516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.575767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.576033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.576281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.576526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.576777 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.577016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.577256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.577496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.577851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.577974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.578172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.578261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.578399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.578634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.578887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.579193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.579467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.579719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.580000 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.580245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.580493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.580734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.580975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.581213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.581452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.581702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.581941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.582188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.582429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.582682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.582921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.583168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.583402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.583648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.583890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 20 21:48:35.584084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80418) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 20 21:48:35.586681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.611699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.611943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.612175 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.615769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.616028 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.620558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.639151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.639383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.758972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.768816 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.814351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.814573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.815874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.816137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.879874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.880127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.880350 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.880575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.880689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.880822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.880931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.881014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.881157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.881378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.881596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.881814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.906453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.906679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.906904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.907127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.907347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.907433 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.907558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.907650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.907766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.907848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.908045 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.908264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.908481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.908698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.918829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.919088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.932439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.932614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.932721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.932801 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.932875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.932995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.933079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.933220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.933305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.933442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.933525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.933660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.933751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.933876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80418) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 20 21:48:35.950933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.951131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 21:48:35.951466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.951666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 21:48:35.951754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.951909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 21:48:35.952016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.953280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.953409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.953512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.953606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 20 21:48:35.953689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.953763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.953763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.954087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.954645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.964347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.964631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.964895 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.965174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.965653 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.965653 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.966251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.966460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.973926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:35.975604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:35.977235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:35.977512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.977792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.978179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.978461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.978721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.978954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:35.979037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.979240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.979331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.979508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.979588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.979778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.979859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.980078 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.980174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.980343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.980612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.981001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.981280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.981558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:35.981828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.006554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.008184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.008460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.010160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.011874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.012257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.013737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.014013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.014286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.018464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.018746 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.019029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.022343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.022624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.026413 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.026698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.027248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.027530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.027808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.028114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.028388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.028657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.028920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.029181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.032077 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.032484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.032774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.033059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.033337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.033615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.033889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.034161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.049777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.050051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.053481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.053760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.054630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.058298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.058586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.058671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.062753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.063051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.063637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.067262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.068223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.071370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.071664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.071898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.072013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.072236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.072514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.072798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.075708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.076029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.076321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.076618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.076908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.077191 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.092661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.093037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.093906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.094170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.098266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.098553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.098822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.099094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.102122 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.103842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.104137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.107333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.107476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.107628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.107804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.108123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.108624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.109214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.109694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.112889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.113175 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.113474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.113760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.114040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.124930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.125205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.125481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.125763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.126046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.126324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.126608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.128218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.128504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.128795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.129075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.129365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.129653 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.129929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.148127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.151306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.151412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.154641 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.154729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.157057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.158700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.158887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.158971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.159250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.160529 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.162185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.162470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.162755 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.166720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.168347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.170326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.171635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.171895 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.172196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.172405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.172503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.175730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.176054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.176344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.176622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.181690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.181976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.182249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.185802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.186091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.186474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.190186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.190462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.190734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.191004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.191270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.191541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.191808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.192093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.192358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.192628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.192898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.193153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.193410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.193675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.194924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80418) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 20 21:48:36.195206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.195486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.195761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.196065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.196348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.196634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.196913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.197191 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.197462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.197739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.198001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.198263 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.198548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80418) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 20 21:48:36.232714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e5f825f9c0 pid: 80419 (default app) Jul 20 21:48:36.236270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ed36f-d7a7-4bb6-b610-88bb0b002a58 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:36.236560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ed36f-d7a7-4bb6-b610-88bb0b002a58 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:36.236835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ed36f-d7a7-4bb6-b610-88bb0b002a58 None None] PATH_INFO: `/v3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:36.238781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55e5f825f9c0 pid: 80418 (default app) Jul 20 21:48:36.240990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 791 bytes} [Wed Jul 20 21:48:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:45.111858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3722a6-96c3-41cf-bb06-26dbb56f4cee None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:45.112414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3722a6-96c3-41cf-bb06-26dbb56f4cee None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:45.112414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3722a6-96c3-41cf-bb06-26dbb56f4cee None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:45.116823 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1/2] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:48:45.122245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:45.122619 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:45.122806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:45.194058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: INFO dbcounter [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] Registered counter for database keystone Jul 20 21:48:45.216222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG oslo_db.sqlalchemy.engines [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:48:45.223354 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writer thread running {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:48:45.403941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG passlib.handlers.bcrypt [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80419) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 21:48:45.404364 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG passlib.handlers.bcrypt [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80419) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 21:48:45.459765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:45.461422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:45.590285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 2/3] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 469 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 20 21:48:45.768595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3722a6-96c3-41cf-bb06-26dbb56f4cee None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:45.838806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: INFO dbcounter [None req-3f3722a6-96c3-41cf-bb06-26dbb56f4cee None None] Registered counter for database keystone Jul 20 21:48:45.858838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG oslo_db.sqlalchemy.engines [None req-3f3722a6-96c3-41cf-bb06-26dbb56f4cee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80418) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 20 21:48:45.865183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writer thread running {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 20 21:48:45.985072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3722a6-96c3-41cf-bb06-26dbb56f4cee None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:45.989461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f24801-cb16-4e92-9d2c-abcd06b82122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:45.990126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24801-cb16-4e92-9d2c-abcd06b82122 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:45.990411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24801-cb16-4e92-9d2c-abcd06b82122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:45.990686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f24801-cb16-4e92-9d2c-abcd06b82122 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:46.000092 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f24801-cb16-4e92-9d2c-abcd06b82122 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:46.052890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WARNING keystone.common.rbac_enforcer.enforcer [None req-22f24801-cb16-4e92-9d2c-abcd06b82122 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 21:48:46.053231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f24801-cb16-4e92-9d2c-abcd06b82122 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:46.064665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 2/4] 10.222.0.85 () {58 vars in 1324 bytes} [Wed Jul 20 21:48:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 21:48:46.070709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:46.085140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4c6fc0-7a62-46a2-ba57-7b8758f82042 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:46.089539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacfe53-0372-4c41-a2ee-93dbc1908176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:46.090696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacfe53-0372-4c41-a2ee-93dbc1908176 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:46.090986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacfe53-0372-4c41-a2ee-93dbc1908176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:46.091260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacfe53-0372-4c41-a2ee-93dbc1908176 admin admin] PATH_INFO: `/v3/projects/e58c029bf3c74b4692bf7afb2155976a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:46.095841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacfe53-0372-4c41-a2ee-93dbc1908176 admin admin] RBAC: Authorizing `identity:get_project(project_id=e58c029bf3c74b4692bf7afb2155976a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:46.147771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5cacfe53-0372-4c41-a2ee-93dbc1908176 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 20 21:48:46.148348 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cacfe53-0372-4c41-a2ee-93dbc1908176 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:46.153196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 3/5] 10.222.0.85 () {56 vars in 1207 bytes} [Wed Jul 20 21:48:46 2022] GET /identity/v3/projects/e58c029bf3c74b4692bf7afb2155976a => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:48.150849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc11c5d-0a8c-4b3a-93d0-a6ad70531825 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:48.151380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc11c5d-0a8c-4b3a-93d0-a6ad70531825 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:48.151478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc11c5d-0a8c-4b3a-93d0-a6ad70531825 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:48.156149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 3/6] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:48:48.161878 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaabca8-c350-4398-ad51-2934d2ff8102 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:48.162306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaabca8-c350-4398-ad51-2934d2ff8102 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:48.162435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaabca8-c350-4398-ad51-2934d2ff8102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:48.180911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fcaabca8-c350-4398-ad51-2934d2ff8102 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:48.182448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fcaabca8-c350-4398-ad51-2934d2ff8102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:48.191140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 4/7] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 20 21:48:48.214088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc11c5d-0a8c-4b3a-93d0-a6ad70531825 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:48.227042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc11c5d-0a8c-4b3a-93d0-a6ad70531825 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:48.231211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295f7b6-60eb-441b-bbf6-c6fc71bd8e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:48.231841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295f7b6-60eb-441b-bbf6-c6fc71bd8e5e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:48.232155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295f7b6-60eb-441b-bbf6-c6fc71bd8e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:48.232435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295f7b6-60eb-441b-bbf6-c6fc71bd8e5e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:48.240509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295f7b6-60eb-441b-bbf6-c6fc71bd8e5e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:48.242286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295f7b6-60eb-441b-bbf6-c6fc71bd8e5e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:48.251365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 4/8] 10.222.0.85 () {58 vars in 1324 bytes} [Wed Jul 20 21:48:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 21:48:48.257001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaabca8-c350-4398-ad51-2934d2ff8102 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:48.266889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaabca8-c350-4398-ad51-2934d2ff8102 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:48.271356 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67d3bf-e304-4c53-babe-955c21d8c44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:48.272248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d3bf-e304-4c53-babe-955c21d8c44d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:48.272535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d3bf-e304-4c53-babe-955c21d8c44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:48.272835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67d3bf-e304-4c53-babe-955c21d8c44d admin admin] PATH_INFO: `/v3/users/b412ad98326b4f4489e43e1f01737fef` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:48.274239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67d3bf-e304-4c53-babe-955c21d8c44d admin admin] RBAC: Authorizing `identity:get_user(user_id=b412ad98326b4f4489e43e1f01737fef)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:48.276172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67d3bf-e304-4c53-babe-955c21d8c44d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:48.277743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 5/9] 10.222.0.85 () {56 vars in 1198 bytes} [Wed Jul 20 21:48:48 2022] GET /identity/v3/users/b412ad98326b4f4489e43e1f01737fef => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:50.394895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc054-2fd0-4308-9e4c-f1c8767b2721 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:50.395402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc054-2fd0-4308-9e4c-f1c8767b2721 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:50.395591 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc054-2fd0-4308-9e4c-f1c8767b2721 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:50.396938 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 5/10] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:48:50.402090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e239216-17bf-4f95-9828-1cea7ab74586 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:50.402461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e239216-17bf-4f95-9828-1cea7ab74586 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:50.402644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e239216-17bf-4f95-9828-1cea7ab74586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:50.419105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4e239216-17bf-4f95-9828-1cea7ab74586 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:50.420308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e239216-17bf-4f95-9828-1cea7ab74586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:50.429353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7a709-163d-47fa-a18b-7e5426399651 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:50.429634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7a709-163d-47fa-a18b-7e5426399651 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:50.429905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce7a709-163d-47fa-a18b-7e5426399651 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:50.432494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 6/11] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:48:50.438301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9881c2-346c-45ff-a461-9b8645d46ec4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:50.438579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9881c2-346c-45ff-a461-9b8645d46ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:50.438851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9881c2-346c-45ff-a461-9b8645d46ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:50.477633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG passlib.handlers.bcrypt [None req-ec9881c2-346c-45ff-a461-9b8645d46ec4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80418) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 20 21:48:50.478059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG passlib.handlers.bcrypt [None req-ec9881c2-346c-45ff-a461-9b8645d46ec4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80418) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 20 21:48:50.504459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 6/12] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:48:50.524521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ec9881c2-346c-45ff-a461-9b8645d46ec4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:50.526119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ec9881c2-346c-45ff-a461-9b8645d46ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:50.526230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e239216-17bf-4f95-9828-1cea7ab74586 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:50.550218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:50.628542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 7/13] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:48:50.631751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e239216-17bf-4f95-9828-1cea7ab74586 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:50.651409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9881c2-346c-45ff-a461-9b8645d46ec4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:50.666082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07025e20-5e79-4cb4-8f96-d40eda56b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:50.666732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07025e20-5e79-4cb4-8f96-d40eda56b365 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:50.667016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07025e20-5e79-4cb4-8f96-d40eda56b365 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:50.667292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07025e20-5e79-4cb4-8f96-d40eda56b365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:50.740111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07025e20-5e79-4cb4-8f96-d40eda56b365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:50.741778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07025e20-5e79-4cb4-8f96-d40eda56b365 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:50.752677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9881c2-346c-45ff-a461-9b8645d46ec4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:50.755097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:50.766698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:50.791221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09050-beb6-46fa-bef8-3d6ec418a947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:50.792311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09050-beb6-46fa-bef8-3d6ec418a947 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:50.792598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09050-beb6-46fa-bef8-3d6ec418a947 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:50.792884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f09050-beb6-46fa-bef8-3d6ec418a947 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:50.805485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f09050-beb6-46fa-bef8-3d6ec418a947 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b4f09050-beb6-46fa-bef8-3d6ec418a947 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:48:50.817187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:48:50.818167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:48:50.818931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 8/14] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:48:50.824401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09050-beb6-46fa-bef8-3d6ec418a947 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:50.844702 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 7/15] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:48:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 21:48:50.850617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07025e20-5e79-4cb4-8f96-d40eda56b365 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:50.932622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f09050-beb6-46fa-bef8-3d6ec418a947 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:50.957280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07025e20-5e79-4cb4-8f96-d40eda56b365 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:50.970280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e325077-6eda-4315-bff3-ea5daf484ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:50.970946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e325077-6eda-4315-bff3-ea5daf484ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:50.971278 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e325077-6eda-4315-bff3-ea5daf484ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:50.971555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e325077-6eda-4315-bff3-ea5daf484ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:50.972345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e325077-6eda-4315-bff3-ea5daf484ad5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:48:50.972656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e325077-6eda-4315-bff3-ea5daf484ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:50.974096 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e325077-6eda-4315-bff3-ea5daf484ad5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:50.981388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:50.986316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 9/16] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:48:50.991870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e325077-6eda-4315-bff3-ea5daf484ad5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:50.992886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a49e7-44ed-4e31-b24d-7a69f740f9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:50.994640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a49e7-44ed-4e31-b24d-7a69f740f9ae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:50.994640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a49e7-44ed-4e31-b24d-7a69f740f9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:50.994640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a49e7-44ed-4e31-b24d-7a69f740f9ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:51.004922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a49e7-44ed-4e31-b24d-7a69f740f9ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:51.006396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a49e7-44ed-4e31-b24d-7a69f740f9ae None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:51.019810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e59a49e7-44ed-4e31-b24d-7a69f740f9ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:48:51.028558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:48:51.029435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:48:51.030448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:48:51.030448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:48:51.030448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:48:51.030448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:48:51.030448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 8/17] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:48:51.036999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a49e7-44ed-4e31-b24d-7a69f740f9ae None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:51.094392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e325077-6eda-4315-bff3-ea5daf484ad5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:51.128868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4b63e-5db8-41d4-a7de-7f7c8d3c66f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:51.129877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4b63e-5db8-41d4-a7de-7f7c8d3c66f3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:51.130393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4b63e-5db8-41d4-a7de-7f7c8d3c66f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:51.130663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4b63e-5db8-41d4-a7de-7f7c8d3c66f3 None admin] PATH_INFO: `/v3/users/b412ad98326b4f4489e43e1f01737fef` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:51.132235 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4b63e-5db8-41d4-a7de-7f7c8d3c66f3 None admin] RBAC: Authorizing `identity:get_user(user_id=b412ad98326b4f4489e43e1f01737fef)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:51.133671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4b63e-5db8-41d4-a7de-7f7c8d3c66f3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:51.135257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 10/18] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:48:50 2022] GET /identity/v3/users/b412ad98326b4f4489e43e1f01737fef => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:48:51.139236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a49e7-44ed-4e31-b24d-7a69f740f9ae None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:51.142997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4b63e-5db8-41d4-a7de-7f7c8d3c66f3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:51.177102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44770d9f-a3c2-46be-bf4a-6d3e9eed784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:51.177761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44770d9f-a3c2-46be-bf4a-6d3e9eed784f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:51.178069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44770d9f-a3c2-46be-bf4a-6d3e9eed784f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:51.178342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44770d9f-a3c2-46be-bf4a-6d3e9eed784f None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:51.179171 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44770d9f-a3c2-46be-bf4a-6d3e9eed784f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:48:51.179478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44770d9f-a3c2-46be-bf4a-6d3e9eed784f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:51.180911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44770d9f-a3c2-46be-bf4a-6d3e9eed784f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:51.199694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 9/19] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:48:51.242508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:51.249487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4b63e-5db8-41d4-a7de-7f7c8d3c66f3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:51.288136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b4abc-fd34-429d-aade-bf01ca10cf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:51.288943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4abc-fd34-429d-aade-bf01ca10cf19 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:51.289223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4abc-fd34-429d-aade-bf01ca10cf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:51.289494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b4abc-fd34-429d-aade-bf01ca10cf19 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:51.290736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b4abc-fd34-429d-aade-bf01ca10cf19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:51.292572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b4abc-fd34-429d-aade-bf01ca10cf19 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:51.294248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 11/20] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:48:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:48:51.301302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44770d9f-a3c2-46be-bf4a-6d3e9eed784f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:51.339992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:51.411788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44770d9f-a3c2-46be-bf4a-6d3e9eed784f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:51.452002 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7949b2fd-edb7-4a1b-a3f2-46f0afa89186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:51.453090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949b2fd-edb7-4a1b-a3f2-46f0afa89186 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:51.453373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949b2fd-edb7-4a1b-a3f2-46f0afa89186 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:51.453859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7949b2fd-edb7-4a1b-a3f2-46f0afa89186 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:51.454743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949b2fd-edb7-4a1b-a3f2-46f0afa89186 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.domain.id=default, user.id=b412ad98326b4f4489e43e1f01737fef) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:48:51.455088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949b2fd-edb7-4a1b-a3f2-46f0afa89186 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:51.456713 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7949b2fd-edb7-4a1b-a3f2-46f0afa89186 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:51.464374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 10/21] 10.222.0.85 () {56 vars in 1322 bytes} [Wed Jul 20 21:48:51 2022] GET /identity/v3/role_assignments?user.id=b412ad98326b4f4489e43e1f01737fef&scope.domain.id=default&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 233 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:53.882077 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35284d-3e2d-4f51-a1a1-cb1dbf66af68 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:53.883499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35284d-3e2d-4f51-a1a1-cb1dbf66af68 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:53.884023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35284d-3e2d-4f51-a1a1-cb1dbf66af68 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:53.885598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 12/22] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:48:53.892472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befefc64-75fd-4497-a0af-5c9c5b661d7a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:53.892910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befefc64-75fd-4497-a0af-5c9c5b661d7a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:53.893028 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befefc64-75fd-4497-a0af-5c9c5b661d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:53.916968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-befefc64-75fd-4497-a0af-5c9c5b661d7a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:53.918479 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-befefc64-75fd-4497-a0af-5c9c5b661d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:54.022882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 11/23] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:48:54.035879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fb59d-23cd-407e-b2de-d2cc210f627e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:54.036192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fb59d-23cd-407e-b2de-d2cc210f627e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:54.036476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1fb59d-23cd-407e-b2de-d2cc210f627e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:54.041383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 13/24] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:48:54.043477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91662308-1afe-4bc1-9c55-60c5f5d5404a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:54.043781 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91662308-1afe-4bc1-9c55-60c5f5d5404a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:54.044099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91662308-1afe-4bc1-9c55-60c5f5d5404a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:54.067484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fb59d-23cd-407e-b2de-d2cc210f627e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:54.068069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-91662308-1afe-4bc1-9c55-60c5f5d5404a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:54.069321 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-91662308-1afe-4bc1-9c55-60c5f5d5404a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:54.113548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:54.204902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 12/25] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:48:54.207148 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9038c-9137-4d39-85f0-2db5334bde76 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:54.207812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9038c-9137-4d39-85f0-2db5334bde76 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:54.210502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a9038c-9137-4d39-85f0-2db5334bde76 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:54.212067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 13/26] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:48:54.218798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b7da9-0ae6-458f-b9ed-8c44431c017d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:54.219528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b7da9-0ae6-458f-b9ed-8c44431c017d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:54.220036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b7da9-0ae6-458f-b9ed-8c44431c017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:54.249351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-266b7da9-0ae6-458f-b9ed-8c44431c017d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:54.251367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-266b7da9-0ae6-458f-b9ed-8c44431c017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:54.268163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1fb59d-23cd-407e-b2de-d2cc210f627e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:54.304841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77155c4d-efea-4d91-a567-41951d617fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:54.305732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77155c4d-efea-4d91-a567-41951d617fb1 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:54.306151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77155c4d-efea-4d91-a567-41951d617fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:54.306560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77155c4d-efea-4d91-a567-41951d617fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:54.307546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77155c4d-efea-4d91-a567-41951d617fb1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:54.309225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77155c4d-efea-4d91-a567-41951d617fb1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:54.330876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 14/27] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:48:54.330876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e501122-e478-4997-a16e-b3f52f57fb5f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:54.330876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e501122-e478-4997-a16e-b3f52f57fb5f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:54.330876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e501122-e478-4997-a16e-b3f52f57fb5f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:54.330876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 15/28] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:48:54.331947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e501122-e478-4997-a16e-b3f52f57fb5f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:54.433665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:54.447161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e501122-e478-4997-a16e-b3f52f57fb5f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:54.484515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc8c9b-8535-4767-98c6-110758858ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:54.485651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc8c9b-8535-4767-98c6-110758858ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:54.486111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc8c9b-8535-4767-98c6-110758858ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:54.486562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc8c9b-8535-4767-98c6-110758858ae1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:54.498603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc8c9b-8535-4767-98c6-110758858ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-35cc8c9b-8535-4767-98c6-110758858ae1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:48:54.507998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:48:54.509005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:48:54.509755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:48:54.512231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 16/29] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:48:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:48:54.513702 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd024-b006-41e9-b61a-3eb4bc9b6e78 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:54.514182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd024-b006-41e9-b61a-3eb4bc9b6e78 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:54.514717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ddd024-b006-41e9-b61a-3eb4bc9b6e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:54.536926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-24ddd024-b006-41e9-b61a-3eb4bc9b6e78 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:54.538174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-24ddd024-b006-41e9-b61a-3eb4bc9b6e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:54.563350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 14/30] 10.222.0.85 () {60 vars in 1131 bytes} [Wed Jul 20 21:48:54 2022] POST /identity/v3/roles => generated 219 bytes in 496 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 21:48:54.564737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77155c4d-efea-4d91-a567-41951d617fb1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:54.609274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:54.670590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 17/31] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:48:54.681065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd024-b006-41e9-b61a-3eb4bc9b6e78 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:54.694469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77155c4d-efea-4d91-a567-41951d617fb1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:54.740790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01494d6-2dae-4cea-9471-257c2aa42af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:54.741625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01494d6-2dae-4cea-9471-257c2aa42af0 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:54.741919 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01494d6-2dae-4cea-9471-257c2aa42af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:54.742196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01494d6-2dae-4cea-9471-257c2aa42af0 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:54.742975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01494d6-2dae-4cea-9471-257c2aa42af0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:54.744589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01494d6-2dae-4cea-9471-257c2aa42af0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:54.794818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:54.818479 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ddd024-b006-41e9-b61a-3eb4bc9b6e78 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:54.823284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 15/32] 10.222.0.85 () {60 vars in 1131 bytes} [Wed Jul 20 21:48:54 2022] POST /identity/v3/roles => generated 225 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:48:54.824630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01494d6-2dae-4cea-9471-257c2aa42af0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:54.897965 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8d120-f9cc-4b95-8164-3d9d8ac14d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:54.900368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d120-f9cc-4b95-8164-3d9d8ac14d2a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:54.901551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d120-f9cc-4b95-8164-3d9d8ac14d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:54.902173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca8d120-f9cc-4b95-8164-3d9d8ac14d2a None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:54.904412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8d120-f9cc-4b95-8164-3d9d8ac14d2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:48:54.906732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8d120-f9cc-4b95-8164-3d9d8ac14d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:54.908426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca8d120-f9cc-4b95-8164-3d9d8ac14d2a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:54.937351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 18/33] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:48:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:54.949086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8d120-f9cc-4b95-8164-3d9d8ac14d2a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:55.023286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:55.047737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01494d6-2dae-4cea-9471-257c2aa42af0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:55.106387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bda8d67-79f6-42ee-9cfe-7eff23fbd01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:55.107191 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda8d67-79f6-42ee-9cfe-7eff23fbd01d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.107472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda8d67-79f6-42ee-9cfe-7eff23fbd01d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.107741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bda8d67-79f6-42ee-9cfe-7eff23fbd01d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.110465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca8d120-f9cc-4b95-8164-3d9d8ac14d2a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:55.129654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda8d67-79f6-42ee-9cfe-7eff23fbd01d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:55.132849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bda8d67-79f6-42ee-9cfe-7eff23fbd01d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-0bda8d67-79f6-42ee-9cfe-7eff23fbd01d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:48:55.154374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:48:55.155726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:48:55.156618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:48:55.156618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:48:55.156618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:48:55.156618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:48:55.156618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 16/34] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:48:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:48:55.158471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbcba8-0ec6-4478-81dc-93a3329090f6 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.158764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbcba8-0ec6-4478-81dc-93a3329090f6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.159040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fbcba8-0ec6-4478-81dc-93a3329090f6 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.160415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 17/35] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:48:55.160525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3731c96-6ed2-4acf-830a-721e8516327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:55.164801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3731c96-6ed2-4acf-830a-721e8516327f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.164801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3731c96-6ed2-4acf-830a-721e8516327f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.164801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3731c96-6ed2-4acf-830a-721e8516327f None admin] PATH_INFO: `/v3/users/b412ad98326b4f4489e43e1f01737fef` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.164801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3731c96-6ed2-4acf-830a-721e8516327f None admin] RBAC: Authorizing `identity:get_user(user_id=b412ad98326b4f4489e43e1f01737fef)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:55.165349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3731c96-6ed2-4acf-830a-721e8516327f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:55.166309 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbcba8-0ec6-4478-81dc-93a3329090f6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:55.167761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 19/36] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:48:54 2022] GET /identity/v3/users/b412ad98326b4f4489e43e1f01737fef => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:55.168978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14b39b-adc6-4685-9944-87265147aa31 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.169262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14b39b-adc6-4685-9944-87265147aa31 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.169539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14b39b-adc6-4685-9944-87265147aa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.193732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4f14b39b-adc6-4685-9944-87265147aa31 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:55.195172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4f14b39b-adc6-4685-9944-87265147aa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:55.197400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:55.276847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 20/37] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:48:55.284390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14b39b-adc6-4685-9944-87265147aa31 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:55.299489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fbcba8-0ec6-4478-81dc-93a3329090f6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:55.337474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19630c40-5793-434c-af6b-cd4d35152aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:55.338142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19630c40-5793-434c-af6b-cd4d35152aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.338428 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19630c40-5793-434c-af6b-cd4d35152aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.338707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19630c40-5793-434c-af6b-cd4d35152aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.339438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19630c40-5793-434c-af6b-cd4d35152aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:48:55.339748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19630c40-5793-434c-af6b-cd4d35152aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:55.341209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19630c40-5793-434c-af6b-cd4d35152aa4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:55.343573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:55.367959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 18/38] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:55.367959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19630c40-5793-434c-af6b-cd4d35152aa4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:55.411206 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f14b39b-adc6-4685-9944-87265147aa31 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:55.445709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7f8fb-35d4-4ab9-91f9-ddf3d0fe7dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:55.446488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f8fb-35d4-4ab9-91f9-ddf3d0fe7dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.446788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f8fb-35d4-4ab9-91f9-ddf3d0fe7dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.447040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f8fb-35d4-4ab9-91f9-ddf3d0fe7dc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.448238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7f8fb-35d4-4ab9-91f9-ddf3d0fe7dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:55.449726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7f8fb-35d4-4ab9-91f9-ddf3d0fe7dc6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:55.451331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 21/39] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:55.452640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7f8fb-35d4-4ab9-91f9-ddf3d0fe7dc6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:55.462300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:55.476623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19630c40-5793-434c-af6b-cd4d35152aa4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:55.512819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f67af-8a67-4bf6-b38b-67aec3ece1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:55.513522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f67af-8a67-4bf6-b38b-67aec3ece1a8 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.513803 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f67af-8a67-4bf6-b38b-67aec3ece1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.514085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f67af-8a67-4bf6-b38b-67aec3ece1a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.514859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f67af-8a67-4bf6-b38b-67aec3ece1a8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:55.516538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f67af-8a67-4bf6-b38b-67aec3ece1a8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:55.556197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7f8fb-35d4-4ab9-91f9-ddf3d0fe7dc6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:55.589763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 19/40] 10.222.0.85 () {60 vars in 1131 bytes} [Wed Jul 20 21:48:55 2022] POST /identity/v3/roles => generated 223 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:48:55.591125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71461-3436-41e7-a94c-444db22f01a5 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.591483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71461-3436-41e7-a94c-444db22f01a5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.591826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f71461-3436-41e7-a94c-444db22f01a5 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.593208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 20/41] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:48:55.593920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71461-3436-41e7-a94c-444db22f01a5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:55.603179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed4e3f-62f3-450d-a29c-fda31e719823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:55.604602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed4e3f-62f3-450d-a29c-fda31e719823 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.604892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed4e3f-62f3-450d-a29c-fda31e719823 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.605232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed4e3f-62f3-450d-a29c-fda31e719823 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.605996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed4e3f-62f3-450d-a29c-fda31e719823 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:55.607629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed4e3f-62f3-450d-a29c-fda31e719823 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:55.667750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:55.727975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f71461-3436-41e7-a94c-444db22f01a5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:55.769342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d0e72f-f198-48dc-8bf6-2e505bbf9282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:55.771906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0e72f-f198-48dc-8bf6-2e505bbf9282 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.771906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0e72f-f198-48dc-8bf6-2e505bbf9282 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.772141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d0e72f-f198-48dc-8bf6-2e505bbf9282 None admin] PATH_INFO: `/v3/domains/default/users/b412ad98326b4f4489e43e1f01737fef/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.775871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0e72f-f198-48dc-8bf6-2e505bbf9282 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b412ad98326b4f4489e43e1f01737fef, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:55.777374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d0e72f-f198-48dc-8bf6-2e505bbf9282 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:55.857140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 21/42] 10.222.0.85 () {58 vars in 1361 bytes} [Wed Jul 20 21:48:55 2022] PUT /identity/v3/domains/default/users/b412ad98326b4f4489e43e1f01737fef/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:48:55.858393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27058b-53ab-4fcb-a53c-745bcaefbf0a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:55.858646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27058b-53ab-4fcb-a53c-745bcaefbf0a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:55.859482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af27058b-53ab-4fcb-a53c-745bcaefbf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:55.879842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-af27058b-53ab-4fcb-a53c-745bcaefbf0a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:55.881630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-af27058b-53ab-4fcb-a53c-745bcaefbf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:55.931962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 22/43] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:48:55 2022] POST /identity/v3/projects => generated 301 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:48:55.978082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 22/44] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:48:56.003270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed4e3f-62f3-450d-a29c-fda31e719823 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:56.085446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:56.136184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed4e3f-62f3-450d-a29c-fda31e719823 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:56.175437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2181e41f-e64c-4c44-9b80-1719f5adeee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:56.176333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181e41f-e64c-4c44-9b80-1719f5adeee8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:56.176624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181e41f-e64c-4c44-9b80-1719f5adeee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:56.176904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2181e41f-e64c-4c44-9b80-1719f5adeee8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:56.178165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181e41f-e64c-4c44-9b80-1719f5adeee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:56.179817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2181e41f-e64c-4c44-9b80-1719f5adeee8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:56.181563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 23/45] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:48:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:56.187803 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27058b-53ab-4fcb-a53c-745bcaefbf0a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:56.236082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:56.292560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af27058b-53ab-4fcb-a53c-745bcaefbf0a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:56.327906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d7240-9c5e-47da-b479-d31e9f0d6a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:56.328593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7240-9c5e-47da-b479-d31e9f0d6a61 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:56.328881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7240-9c5e-47da-b479-d31e9f0d6a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:56.329160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d7240-9c5e-47da-b479-d31e9f0d6a61 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:56.329884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d7240-9c5e-47da-b479-d31e9f0d6a61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:56.331352 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d7240-9c5e-47da-b479-d31e9f0d6a61 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:56.417988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 23/46] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:48:56 2022] POST /identity/v3/projects => generated 312 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:48:57.955421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9f0a1-99c9-4f85-b67d-a141b7d23783 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:57.956970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9f0a1-99c9-4f85-b67d-a141b7d23783 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:57.956970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea9f0a1-99c9-4f85-b67d-a141b7d23783 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:57.957424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 24/47] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:48:57.963400 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80f7c-5755-4731-ba7c-fab71f314619 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:57.963858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80f7c-5755-4731-ba7c-fab71f314619 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:57.963971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e80f7c-5755-4731-ba7c-fab71f314619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:57.984098 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-73e80f7c-5755-4731-ba7c-fab71f314619 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:57.985293 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-73e80f7c-5755-4731-ba7c-fab71f314619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:58.058586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 24/48] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:48:58.094459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9f0a1-99c9-4f85-b67d-a141b7d23783 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:58.203152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea9f0a1-99c9-4f85-b67d-a141b7d23783 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:58.233915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:58.247191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7ddef-c365-47b8-a4bb-76c3bf082595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:58.250080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7ddef-c365-47b8-a4bb-76c3bf082595 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:58.250080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7ddef-c365-47b8-a4bb-76c3bf082595 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:58.250329 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb7ddef-c365-47b8-a4bb-76c3bf082595 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:58.265504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb7ddef-c365-47b8-a4bb-76c3bf082595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-eeb7ddef-c365-47b8-a4bb-76c3bf082595 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:48:58.273170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:48:58.274360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:48:58.275289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 25/49] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:48:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:48:58.280433 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e80f7c-5755-4731-ba7c-fab71f314619 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:58.311998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:58.389866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e80f7c-5755-4731-ba7c-fab71f314619 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:58.426933 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84a8fc3-cdee-407f-9bef-b81bf69f04e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:58.427612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a8fc3-cdee-407f-9bef-b81bf69f04e5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:58.427895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a8fc3-cdee-407f-9bef-b81bf69f04e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:58.428202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84a8fc3-cdee-407f-9bef-b81bf69f04e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:58.428965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a8fc3-cdee-407f-9bef-b81bf69f04e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:48:58.429272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a8fc3-cdee-407f-9bef-b81bf69f04e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:58.430687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84a8fc3-cdee-407f-9bef-b81bf69f04e5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:58.440441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 25/50] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:48:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:58.446205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7ddef-c365-47b8-a4bb-76c3bf082595 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:58.504801 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec476669-4983-4ae8-837f-60349bb4e052 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:58.505092 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec476669-4983-4ae8-837f-60349bb4e052 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:58.505374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec476669-4983-4ae8-837f-60349bb4e052 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:58.506785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 26/51] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:48:58.512146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04347b3-3868-4dee-a0af-725cff6f04c3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:58.512434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04347b3-3868-4dee-a0af-725cff6f04c3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:58.512718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04347b3-3868-4dee-a0af-725cff6f04c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:58.530832 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a04347b3-3868-4dee-a0af-725cff6f04c3 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:48:58.532218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a04347b3-3868-4dee-a0af-725cff6f04c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:48:58.582484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb7ddef-c365-47b8-a4bb-76c3bf082595 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:58.603371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 27/52] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:48:58.621212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d701dc-e6a8-4ddd-8499-01d7375f8a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:58.622087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d701dc-e6a8-4ddd-8499-01d7375f8a26 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:58.622383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d701dc-e6a8-4ddd-8499-01d7375f8a26 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:58.622640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d701dc-e6a8-4ddd-8499-01d7375f8a26 None admin] PATH_INFO: `/v3/users/b412ad98326b4f4489e43e1f01737fef` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:58.624582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d701dc-e6a8-4ddd-8499-01d7375f8a26 None admin] RBAC: Authorizing `identity:get_user(user_id=b412ad98326b4f4489e43e1f01737fef)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:58.626059 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d701dc-e6a8-4ddd-8499-01d7375f8a26 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:58.627643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04347b3-3868-4dee-a0af-725cff6f04c3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:58.627748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 26/53] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:48:58 2022] GET /identity/v3/users/b412ad98326b4f4489e43e1f01737fef => generated 247 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:58.632799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d701dc-e6a8-4ddd-8499-01d7375f8a26 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:58.646143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:58.689187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:58.729840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04347b3-3868-4dee-a0af-725cff6f04c3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:58.736442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d701dc-e6a8-4ddd-8499-01d7375f8a26 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:58.784705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e99d3b-c6ea-4ddb-a1d3-c6d196013dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:58.785448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e99d3b-c6ea-4ddb-a1d3-c6d196013dcd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:58.785737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e99d3b-c6ea-4ddb-a1d3-c6d196013dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:58.786016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e99d3b-c6ea-4ddb-a1d3-c6d196013dcd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:58.787288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e99d3b-c6ea-4ddb-a1d3-c6d196013dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:58.788885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e99d3b-c6ea-4ddb-a1d3-c6d196013dcd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:58.790623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 27/54] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:48:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:48:58.797868 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e99d3b-c6ea-4ddb-a1d3-c6d196013dcd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:58.870924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39203ab6-10b8-43dd-939a-11efd1120739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:58.871721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203ab6-10b8-43dd-939a-11efd1120739 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:58.872034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203ab6-10b8-43dd-939a-11efd1120739 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:58.872311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39203ab6-10b8-43dd-939a-11efd1120739 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:58.873531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39203ab6-10b8-43dd-939a-11efd1120739 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:58.875055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39203ab6-10b8-43dd-939a-11efd1120739 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:58.876707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 28/55] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:48:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:48:58.883007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39203ab6-10b8-43dd-939a-11efd1120739 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:48:58.905190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e99d3b-c6ea-4ddb-a1d3-c6d196013dcd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:58.928372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:58.939831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae516e9-9e69-4307-8240-352b57c9f1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:58.940504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae516e9-9e69-4307-8240-352b57c9f1ce None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:58.940797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae516e9-9e69-4307-8240-352b57c9f1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:58.941074 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae516e9-9e69-4307-8240-352b57c9f1ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:58.941919 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae516e9-9e69-4307-8240-352b57c9f1ce None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.domain.id=default, user.id=b412ad98326b4f4489e43e1f01737fef) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:48:58.942232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae516e9-9e69-4307-8240-352b57c9f1ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:58.943725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae516e9-9e69-4307-8240-352b57c9f1ce None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:58.949715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 28/56] 10.222.0.85 () {56 vars in 1322 bytes} [Wed Jul 20 21:48:58 2022] GET /identity/v3/role_assignments?user.id=b412ad98326b4f4489e43e1f01737fef&scope.domain.id=default&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 530 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:48:58.974414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:48:58.991056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39203ab6-10b8-43dd-939a-11efd1120739 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:48:59.028968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7debde6c-5f28-451c-af49-a9b93602eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:48:59.030228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debde6c-5f28-451c-af49-a9b93602eb2c None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:48:59.030462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debde6c-5f28-451c-af49-a9b93602eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:48:59.030787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7debde6c-5f28-451c-af49-a9b93602eb2c None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:48:59.031540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debde6c-5f28-451c-af49-a9b93602eb2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:48:59.033109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7debde6c-5f28-451c-af49-a9b93602eb2c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:48:59.146215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 29/57] 10.222.0.85 () {60 vars in 1140 bytes} [Wed Jul 20 21:48:58 2022] POST /identity/v3/projects => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 21:49:01.234441 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fe675-df0f-4c20-908b-ce3d58dcc7cc None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:01.234987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fe675-df0f-4c20-908b-ce3d58dcc7cc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:01.234987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fe675-df0f-4c20-908b-ce3d58dcc7cc None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:01.236418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 29/58] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:01.241719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7457-497a-493c-99f8-d5ad43663c4b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:01.242208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7457-497a-493c-99f8-d5ad43663c4b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:01.242378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7457-497a-493c-99f8-d5ad43663c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:01.260209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-404d7457-497a-493c-99f8-d5ad43663c4b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:01.261420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-404d7457-497a-493c-99f8-d5ad43663c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:01.330836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 30/59] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:01.356002 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fe675-df0f-4c20-908b-ce3d58dcc7cc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:01.457470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fe675-df0f-4c20-908b-ce3d58dcc7cc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:01.489937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28877c49-d3b4-4551-b8dc-642fee9d8f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:01.490662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28877c49-d3b4-4551-b8dc-642fee9d8f34 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:01.490946 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28877c49-d3b4-4551-b8dc-642fee9d8f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:01.491229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28877c49-d3b4-4551-b8dc-642fee9d8f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:01.492570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28877c49-d3b4-4551-b8dc-642fee9d8f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:01.494029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28877c49-d3b4-4551-b8dc-642fee9d8f34 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:01.495633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 30/60] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:01.502250 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7457-497a-493c-99f8-d5ad43663c4b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:01.567937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:01.599912 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7457-497a-493c-99f8-d5ad43663c4b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:01.633956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1937a331-5715-48a1-a839-c4225596ab13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:01.634617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a331-5715-48a1-a839-c4225596ab13 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:01.634905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a331-5715-48a1-a839-c4225596ab13 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:01.635186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a331-5715-48a1-a839-c4225596ab13 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:01.635893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937a331-5715-48a1-a839-c4225596ab13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:01.637416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1937a331-5715-48a1-a839-c4225596ab13 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:01.747251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 31/61] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:01 2022] POST /identity/v3/users => generated 275 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:05.060365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fec6e2-f106-49e7-ada4-836226ae32a6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.061750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fec6e2-f106-49e7-ada4-836226ae32a6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.062260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fec6e2-f106-49e7-ada4-836226ae32a6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.063850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 31/62] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:05.069324 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032098d-0e27-4bcf-a941-61d8ec91702f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.070140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032098d-0e27-4bcf-a941-61d8ec91702f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.070620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b032098d-0e27-4bcf-a941-61d8ec91702f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.097752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e13643-f7ed-4a31-bce2-65f9535c2547 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.098053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e13643-f7ed-4a31-bce2-65f9535c2547 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.098330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e13643-f7ed-4a31-bce2-65f9535c2547 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.099854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 32/63] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:05.100683 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b032098d-0e27-4bcf-a941-61d8ec91702f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:05.101951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b032098d-0e27-4bcf-a941-61d8ec91702f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:05.107664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de773-a0b1-4b00-a4e6-565129e1ffbf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.108505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de773-a0b1-4b00-a4e6-565129e1ffbf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.108818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560de773-a0b1-4b00-a4e6-565129e1ffbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.138270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-560de773-a0b1-4b00-a4e6-565129e1ffbf None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:05.140963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-560de773-a0b1-4b00-a4e6-565129e1ffbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:05.199672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 32/64] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:05.206256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571810b-4772-423c-bb8d-3b5f3986e6dd None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.207540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571810b-4772-423c-bb8d-3b5f3986e6dd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.208222 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571810b-4772-423c-bb8d-3b5f3986e6dd None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.210861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 33/65] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:05.216949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af479d-4c6e-442a-b5fc-11fd898478e3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.218694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af479d-4c6e-442a-b5fc-11fd898478e3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.219372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37af479d-4c6e-442a-b5fc-11fd898478e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.241886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-37af479d-4c6e-442a-b5fc-11fd898478e3 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:05.243125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-37af479d-4c6e-442a-b5fc-11fd898478e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:05.247700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:05.275900 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 33/66] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:05.298358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560de773-a0b1-4b00-a4e6-565129e1ffbf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:05.324434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:05.347177 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 34/67] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:05.348678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af479d-4c6e-442a-b5fc-11fd898478e3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:05.411336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560de773-a0b1-4b00-a4e6-565129e1ffbf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:05.451066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55662bbf-19cd-45a9-8820-98b02a30475a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:05.452618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662bbf-19cd-45a9-8820-98b02a30475a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.452819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662bbf-19cd-45a9-8820-98b02a30475a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.453093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55662bbf-19cd-45a9-8820-98b02a30475a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.464400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55662bbf-19cd-45a9-8820-98b02a30475a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:05.465667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37af479d-4c6e-442a-b5fc-11fd898478e3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-55662bbf-19cd-45a9-8820-98b02a30475a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:05.472976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:05.473869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 34/68] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:49:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:05.475114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55662bbf-19cd-45a9-8820-98b02a30475a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:05.508069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9123adc1-21e8-4b19-af4c-dbe453d5ea93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:05.508904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123adc1-21e8-4b19-af4c-dbe453d5ea93 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.509187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123adc1-21e8-4b19-af4c-dbe453d5ea93 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.509470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9123adc1-21e8-4b19-af4c-dbe453d5ea93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.522415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9123adc1-21e8-4b19-af4c-dbe453d5ea93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:05.524738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9123adc1-21e8-4b19-af4c-dbe453d5ea93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:05.531379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:05.533990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:05.534756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 35/69] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:05.537445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43299b5-b221-4091-ae97-d4a8a4f32ea8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.537744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43299b5-b221-4091-ae97-d4a8a4f32ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.538025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43299b5-b221-4091-ae97-d4a8a4f32ea8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.539348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 36/70] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:05.541122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43299b5-b221-4091-ae97-d4a8a4f32ea8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:05.591933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55662bbf-19cd-45a9-8820-98b02a30475a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:05.595244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:05.629561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c58f13-9636-4638-bda7-237f05da2a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:05.630383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c58f13-9636-4638-bda7-237f05da2a4e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.630671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c58f13-9636-4638-bda7-237f05da2a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.630951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c58f13-9636-4638-bda7-237f05da2a4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.642542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c58f13-9636-4638-bda7-237f05da2a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-60c58f13-9636-4638-bda7-237f05da2a4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:05.650667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:05.651693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 35/71] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:05.652681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c58f13-9636-4638-bda7-237f05da2a4e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:05.662402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43299b5-b221-4091-ae97-d4a8a4f32ea8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:05.697403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26befcd7-4e5a-429f-bd2c-0be23b61337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:05.698073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befcd7-4e5a-429f-bd2c-0be23b61337b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.698357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befcd7-4e5a-429f-bd2c-0be23b61337b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.698640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26befcd7-4e5a-429f-bd2c-0be23b61337b None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.699393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26befcd7-4e5a-429f-bd2c-0be23b61337b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:05.699702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26befcd7-4e5a-429f-bd2c-0be23b61337b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:05.701241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26befcd7-4e5a-429f-bd2c-0be23b61337b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:05.710198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 37/72] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:05.713269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9658d-f47e-4158-9539-23abbbbb1dd7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.713565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9658d-f47e-4158-9539-23abbbbb1dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.713851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9658d-f47e-4158-9539-23abbbbb1dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.730471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-81a9658d-f47e-4158-9539-23abbbbb1dd7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:05.731676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-81a9658d-f47e-4158-9539-23abbbbb1dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:05.757022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c58f13-9636-4638-bda7-237f05da2a4e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:05.759266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:05.790344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27bef2e-650d-4243-9b19-bc155440c4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:05.791063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bef2e-650d-4243-9b19-bc155440c4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.791515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bef2e-650d-4243-9b19-bc155440c4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.791987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27bef2e-650d-4243-9b19-bc155440c4d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.793215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bef2e-650d-4243-9b19-bc155440c4d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:05.793539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bef2e-650d-4243-9b19-bc155440c4d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:05.794959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27bef2e-650d-4243-9b19-bc155440c4d7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:05.798225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 38/73] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:05.801464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9658d-f47e-4158-9539-23abbbbb1dd7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:05.805524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 36/74] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:05.807784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb74e8-5614-40dd-a659-c2ba6aac8bcb None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.808118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb74e8-5614-40dd-a659-c2ba6aac8bcb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.808398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afb74e8-5614-40dd-a659-c2ba6aac8bcb None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.809847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 37/75] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:05.815160 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb74e8-5614-40dd-a659-c2ba6aac8bcb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:05.836495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:05.902815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9658d-f47e-4158-9539-23abbbbb1dd7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:05.918673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afb74e8-5614-40dd-a659-c2ba6aac8bcb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:05.938628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834ded7-fb11-4dfb-8085-51406cd012df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:05.939306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834ded7-fb11-4dfb-8085-51406cd012df None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.939587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834ded7-fb11-4dfb-8085-51406cd012df None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.939871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4834ded7-fb11-4dfb-8085-51406cd012df None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.940650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834ded7-fb11-4dfb-8085-51406cd012df None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:05.940957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834ded7-fb11-4dfb-8085-51406cd012df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:05.942360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4834ded7-fb11-4dfb-8085-51406cd012df None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:05.953891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 39/76] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:05.954132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b379e5-2d61-4e20-a701-ea0d1a686373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:05.954675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834ded7-fb11-4dfb-8085-51406cd012df None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:05.954957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b379e5-2d61-4e20-a701-ea0d1a686373 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.955286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b379e5-2d61-4e20-a701-ea0d1a686373 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.955631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b379e5-2d61-4e20-a701-ea0d1a686373 None admin] PATH_INFO: `/v3/users/b412ad98326b4f4489e43e1f01737fef` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.956833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b379e5-2d61-4e20-a701-ea0d1a686373 None admin] RBAC: Authorizing `identity:get_user(user_id=b412ad98326b4f4489e43e1f01737fef)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:05.958415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b379e5-2d61-4e20-a701-ea0d1a686373 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:05.960415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 38/77] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:05 2022] GET /identity/v3/users/b412ad98326b4f4489e43e1f01737fef => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:05.961696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94fdfe-d60c-404c-af06-d35963fb8c6f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:05.961985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94fdfe-d60c-404c-af06-d35963fb8c6f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:05.962261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff94fdfe-d60c-404c-af06-d35963fb8c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:05.980019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ff94fdfe-d60c-404c-af06-d35963fb8c6f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:05.981278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ff94fdfe-d60c-404c-af06-d35963fb8c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:06.012403 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:06.057853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 39/78] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:06.058968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94fdfe-d60c-404c-af06-d35963fb8c6f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:06.067878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:06.072585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4834ded7-fb11-4dfb-8085-51406cd012df None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:06.113492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7efad-ceba-4158-aa08-aefa1c28d79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:06.114359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7efad-ceba-4158-aa08-aefa1c28d79a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:06.114650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7efad-ceba-4158-aa08-aefa1c28d79a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:06.114927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7efad-ceba-4158-aa08-aefa1c28d79a None admin] PATH_INFO: `/v3/users/77833c08172c4aa2bc9b92c7124c3fe5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:06.130865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7efad-ceba-4158-aa08-aefa1c28d79a None admin] RBAC: Authorizing `identity:get_user(user_id=77833c08172c4aa2bc9b92c7124c3fe5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:06.132651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee7efad-ceba-4158-aa08-aefa1c28d79a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:06.134372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 40/79] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:05 2022] GET /identity/v3/users/77833c08172c4aa2bc9b92c7124c3fe5 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:06.135138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7efad-ceba-4158-aa08-aefa1c28d79a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:06.173473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff94fdfe-d60c-404c-af06-d35963fb8c6f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:06.208087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c55ab-a849-4f53-b134-82068d3a81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:06.208803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c55ab-a849-4f53-b134-82068d3a81ec None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:06.209084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c55ab-a849-4f53-b134-82068d3a81ec None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:06.209358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c55ab-a849-4f53-b134-82068d3a81ec None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:06.224631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726c55ab-a849-4f53-b134-82068d3a81ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-726c55ab-a849-4f53-b134-82068d3a81ec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:06.232483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:06.233339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:06.234109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 40/80] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:06.234750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c55ab-a849-4f53-b134-82068d3a81ec None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:06.245603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee7efad-ceba-4158-aa08-aefa1c28d79a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:06.260591 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:06.279132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde63bd-729c-4109-aa82-faf488c57350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:06.281133 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde63bd-729c-4109-aa82-faf488c57350 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:06.281522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde63bd-729c-4109-aa82-faf488c57350 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:06.281934 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde63bd-729c-4109-aa82-faf488c57350 None admin] PATH_INFO: `/v3/users/77833c08172c4aa2bc9b92c7124c3fe5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:06.283390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde63bd-729c-4109-aa82-faf488c57350 None admin] RBAC: Authorizing `identity:get_user(user_id=77833c08172c4aa2bc9b92c7124c3fe5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:06.284888 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde63bd-729c-4109-aa82-faf488c57350 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:06.286539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 41/81] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:06 2022] GET /identity/v3/users/77833c08172c4aa2bc9b92c7124c3fe5 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:06.287309 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde63bd-729c-4109-aa82-faf488c57350 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:06.313971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:06.344337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726c55ab-a849-4f53-b134-82068d3a81ec None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:06.377340 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd87895-db9b-4066-b965-ee7ad7f9f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:06.377978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87895-db9b-4066-b965-ee7ad7f9f784 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:06.378257 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87895-db9b-4066-b965-ee7ad7f9f784 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:06.378535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd87895-db9b-4066-b965-ee7ad7f9f784 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:06.391023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde63bd-729c-4109-aa82-faf488c57350 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:06.423716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84e164-33b7-4d30-956e-c16c29356a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:06.424532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84e164-33b7-4d30-956e-c16c29356a56 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:06.424809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84e164-33b7-4d30-956e-c16c29356a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:06.425086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc84e164-33b7-4d30-956e-c16c29356a56 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:06.426255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84e164-33b7-4d30-956e-c16c29356a56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:06.427691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc84e164-33b7-4d30-956e-c16c29356a56 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:06.429329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 42/82] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:06.430095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84e164-33b7-4d30-956e-c16c29356a56 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:06.447753 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd87895-db9b-4066-b965-ee7ad7f9f784 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:06.449282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd87895-db9b-4066-b965-ee7ad7f9f784 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:06.473455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:06.523993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:06.535295 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc84e164-33b7-4d30-956e-c16c29356a56 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:06.550709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 41/83] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:06.551560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd87895-db9b-4066-b965-ee7ad7f9f784 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:06.574203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871fa0d-1079-4233-a2de-9fb639bf05e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:06.574896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871fa0d-1079-4233-a2de-9fb639bf05e6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:06.575184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871fa0d-1079-4233-a2de-9fb639bf05e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:06.575461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871fa0d-1079-4233-a2de-9fb639bf05e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:06.643756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871fa0d-1079-4233-a2de-9fb639bf05e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:06.645289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871fa0d-1079-4233-a2de-9fb639bf05e6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:06.649429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd87895-db9b-4066-b965-ee7ad7f9f784 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:06.672074 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:06.682161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363a382-e97d-4b7c-abf5-9078e3a017b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:06.682823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363a382-e97d-4b7c-abf5-9078e3a017b3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:06.683114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363a382-e97d-4b7c-abf5-9078e3a017b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:06.683389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363a382-e97d-4b7c-abf5-9078e3a017b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:06.684175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363a382-e97d-4b7c-abf5-9078e3a017b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:06.686370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363a382-e97d-4b7c-abf5-9078e3a017b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:06.686652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363a382-e97d-4b7c-abf5-9078e3a017b3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:06.699322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 42/84] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:06.699322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363a382-e97d-4b7c-abf5-9078e3a017b3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:06.734595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:06.743679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 43/85] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:06.744518 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871fa0d-1079-4233-a2de-9fb639bf05e6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:06.801559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363a382-e97d-4b7c-abf5-9078e3a017b3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:06.834850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe813884-4e4d-4d8d-96b4-71b81d23126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:06.835486 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe813884-4e4d-4d8d-96b4-71b81d23126f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:06.835767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe813884-4e4d-4d8d-96b4-71b81d23126f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:06.836091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe813884-4e4d-4d8d-96b4-71b81d23126f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:06.843514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871fa0d-1079-4233-a2de-9fb639bf05e6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:06.879504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781db7f-0c53-4eec-9a11-a5796081daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:06.880204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781db7f-0c53-4eec-9a11-a5796081daf6 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:06.880490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781db7f-0c53-4eec-9a11-a5796081daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:06.880767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781db7f-0c53-4eec-9a11-a5796081daf6 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:06.881489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781db7f-0c53-4eec-9a11-a5796081daf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:06.882942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781db7f-0c53-4eec-9a11-a5796081daf6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:06.891624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:06.905672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe813884-4e4d-4d8d-96b4-71b81d23126f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:06.907132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe813884-4e4d-4d8d-96b4-71b81d23126f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:07.003679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 43/86] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:07.004597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe813884-4e4d-4d8d-96b4-71b81d23126f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:07.033336 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 44/87] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:06 2022] POST /identity/v3/users => generated 289 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:07.034190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781db7f-0c53-4eec-9a11-a5796081daf6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:07.091624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:07.108786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:07.124981 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe813884-4e4d-4d8d-96b4-71b81d23126f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:07.152607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781db7f-0c53-4eec-9a11-a5796081daf6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:07.162443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641e5bc-6c1e-43ce-97dc-258275a6f661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:07.163359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641e5bc-6c1e-43ce-97dc-258275a6f661 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:07.163677 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641e5bc-6c1e-43ce-97dc-258275a6f661 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:07.164022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5641e5bc-6c1e-43ce-97dc-258275a6f661 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:07.165300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641e5bc-6c1e-43ce-97dc-258275a6f661 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:07.166783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5641e5bc-6c1e-43ce-97dc-258275a6f661 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:07.168611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 44/88] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:07 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:07.172473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641e5bc-6c1e-43ce-97dc-258275a6f661 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:07.206164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b844f7-cc6a-4b45-af01-d483eb506e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:07.207051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b844f7-cc6a-4b45-af01-d483eb506e6d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:07.207339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b844f7-cc6a-4b45-af01-d483eb506e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:07.207631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b844f7-cc6a-4b45-af01-d483eb506e6d None admin] PATH_INFO: `/v3/users/77833c08172c4aa2bc9b92c7124c3fe5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:07.208955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b844f7-cc6a-4b45-af01-d483eb506e6d None admin] RBAC: Authorizing `identity:get_user(user_id=77833c08172c4aa2bc9b92c7124c3fe5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:07.210437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b844f7-cc6a-4b45-af01-d483eb506e6d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:07.212808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 45/89] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:07 2022] GET /identity/v3/users/77833c08172c4aa2bc9b92c7124c3fe5 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:07.213132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b844f7-cc6a-4b45-af01-d483eb506e6d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:07.306173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5641e5bc-6c1e-43ce-97dc-258275a6f661 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:07.334828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b844f7-cc6a-4b45-af01-d483eb506e6d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:07.354009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0e36c-c52e-4fa9-9d73-ce5d363aa484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:07.354873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e36c-c52e-4fa9-9d73-ce5d363aa484 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:07.355157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e36c-c52e-4fa9-9d73-ce5d363aa484 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:07.355596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:07.356521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0e36c-c52e-4fa9-9d73-ce5d363aa484 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:07.358462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0e36c-c52e-4fa9-9d73-ce5d363aa484 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:07.359959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e0e36c-c52e-4fa9-9d73-ce5d363aa484 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:07.361685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 45/90] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:07 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:07.362472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0e36c-c52e-4fa9-9d73-ce5d363aa484 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:07.379282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb953-afc1-4353-9768-c160989bd01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:07.380625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb953-afc1-4353-9768-c160989bd01c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:07.380625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb953-afc1-4353-9768-c160989bd01c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:07.380785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbeb953-afc1-4353-9768-c160989bd01c None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:07.382305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb953-afc1-4353-9768-c160989bd01c None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:07.383617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbeb953-afc1-4353-9768-c160989bd01c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:07.385208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 46/91] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:07 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:07.386063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb953-afc1-4353-9768-c160989bd01c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:07.396253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:07.480176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0e36c-c52e-4fa9-9d73-ce5d363aa484 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:07.503063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbeb953-afc1-4353-9768-c160989bd01c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:07.529174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da811bb0-cce4-4ad8-a7c7-d7ecb075679c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:07.530893 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da811bb0-cce4-4ad8-a7c7-d7ecb075679c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:07.531366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da811bb0-cce4-4ad8-a7c7-d7ecb075679c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:07.531817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da811bb0-cce4-4ad8-a7c7-d7ecb075679c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:07.533841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da811bb0-cce4-4ad8-a7c7-d7ecb075679c None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=37a366467c364c32b052631d9f1b6e63, user.id=b412ad98326b4f4489e43e1f01737fef) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:07.534305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da811bb0-cce4-4ad8-a7c7-d7ecb075679c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:07.536629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da811bb0-cce4-4ad8-a7c7-d7ecb075679c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:07.542846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161a11-3d38-4157-826b-5957a177ea0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:07.543613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161a11-3d38-4157-826b-5957a177ea0d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:07.544053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161a11-3d38-4157-826b-5957a177ea0d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:07.544423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75161a11-3d38-4157-826b-5957a177ea0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:07.545505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 46/92] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:07 2022] GET /identity/v3/role_assignments?user.id=b412ad98326b4f4489e43e1f01737fef&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:07.551952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da811bb0-cce4-4ad8-a7c7-d7ecb075679c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:07.654284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:07.692514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75161a11-3d38-4157-826b-5957a177ea0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:07.694013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75161a11-3d38-4157-826b-5957a177ea0d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:07.742010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:07.780079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da811bb0-cce4-4ad8-a7c7-d7ecb075679c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:07.851466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f63cef-3e37-4ee4-b654-df965f2722f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:07.854014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63cef-3e37-4ee4-b654-df965f2722f6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:07.854479 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63cef-3e37-4ee4-b654-df965f2722f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:07.856167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f63cef-3e37-4ee4-b654-df965f2722f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:07.857195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f63cef-3e37-4ee4-b654-df965f2722f6 None admin] RBAC: Adding query filter params (role.id=36dde009f57f45dd9ded880f26a9b2cc, scope.project.id=37a366467c364c32b052631d9f1b6e63, user.id=77833c08172c4aa2bc9b92c7124c3fe5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:07.859254 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f63cef-3e37-4ee4-b654-df965f2722f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:07.860933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f63cef-3e37-4ee4-b654-df965f2722f6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:07.878092 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 47/93] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:07 2022] GET /identity/v3/role_assignments?user.id=77833c08172c4aa2bc9b92c7124c3fe5&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 259 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:07.879030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f63cef-3e37-4ee4-b654-df965f2722f6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:07.896980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 47/94] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:07.902819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161a11-3d38-4157-826b-5957a177ea0d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:08.070519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:08.096596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75161a11-3d38-4157-826b-5957a177ea0d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:08.150484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecc6fe-1a3b-4168-af61-d69084b6e0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:08.151684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecc6fe-1a3b-4168-af61-d69084b6e0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:08.152226 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecc6fe-1a3b-4168-af61-d69084b6e0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:08.152714 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecc6fe-1a3b-4168-af61-d69084b6e0e4 None admin] PATH_INFO: `/v3/projects/9a20c633c43047a19da99ed7d4330943` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:08.154178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecc6fe-1a3b-4168-af61-d69084b6e0e4 None admin] RBAC: Authorizing `identity:get_project(project_id=9a20c633c43047a19da99ed7d4330943)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:08.156458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eecc6fe-1a3b-4168-af61-d69084b6e0e4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:08.159154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 48/95] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:07 2022] GET /identity/v3/projects/9a20c633c43047a19da99ed7d4330943 => generated 312 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:08.165159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecc6fe-1a3b-4168-af61-d69084b6e0e4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:08.169212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f63cef-3e37-4ee4-b654-df965f2722f6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:08.266215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42906ed-ceb9-40bb-85c4-43cd93545d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:08.266894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42906ed-ceb9-40bb-85c4-43cd93545d29 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:08.267181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42906ed-ceb9-40bb-85c4-43cd93545d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:08.267461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42906ed-ceb9-40bb-85c4-43cd93545d29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:08.268346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42906ed-ceb9-40bb-85c4-43cd93545d29 None admin] RBAC: Adding query filter params (role.id=5b16ed690a6942c288df268569b6ab85, scope.project.id=37a366467c364c32b052631d9f1b6e63, user.id=77833c08172c4aa2bc9b92c7124c3fe5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:08.268664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42906ed-ceb9-40bb-85c4-43cd93545d29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:08.270117 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42906ed-ceb9-40bb-85c4-43cd93545d29 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:08.286190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 48/96] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:07 2022] GET /identity/v3/role_assignments?user.id=77833c08172c4aa2bc9b92c7124c3fe5&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=5b16ed690a6942c288df268569b6ab85 => generated 259 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:08.353677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecc6fe-1a3b-4168-af61-d69084b6e0e4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:08.406592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684fb698-c189-4c44-b357-30bbe8e533cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:08.407260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fb698-c189-4c44-b357-30bbe8e533cf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:08.407550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fb698-c189-4c44-b357-30bbe8e533cf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:08.407824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684fb698-c189-4c44-b357-30bbe8e533cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:08.408702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fb698-c189-4c44-b357-30bbe8e533cf None admin] RBAC: Adding query filter params (role.id=36dde009f57f45dd9ded880f26a9b2cc, scope.project.id=9a20c633c43047a19da99ed7d4330943, user.id=77833c08172c4aa2bc9b92c7124c3fe5) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:08.409020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fb698-c189-4c44-b357-30bbe8e533cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:08.410506 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684fb698-c189-4c44-b357-30bbe8e533cf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:08.427565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 49/97] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:08 2022] GET /identity/v3/role_assignments?user.id=77833c08172c4aa2bc9b92c7124c3fe5&scope.project.id=9a20c633c43047a19da99ed7d4330943&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:09.660272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ac09-4dd1-41de-9d77-d71c9e3f8cc0 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:09.660782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ac09-4dd1-41de-9d77-d71c9e3f8cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:09.660855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4ac09-4dd1-41de-9d77-d71c9e3f8cc0 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:09.662181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 49/98] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:09.667680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524072ec-115e-43a9-b0a5-391f51bee5fc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:09.668565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524072ec-115e-43a9-b0a5-391f51bee5fc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:09.669035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524072ec-115e-43a9-b0a5-391f51bee5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:09.692942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-524072ec-115e-43a9-b0a5-391f51bee5fc None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:09.694472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-524072ec-115e-43a9-b0a5-391f51bee5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:09.707298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:09.778868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 50/99] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:09.814181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4ac09-4dd1-41de-9d77-d71c9e3f8cc0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:09.837657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:09.857383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028e76b-6a6d-4375-a8d7-21959b0adc3d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:09.857720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028e76b-6a6d-4375-a8d7-21959b0adc3d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:09.857945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028e76b-6a6d-4375-a8d7-21959b0adc3d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:09.859460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 51/100] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:09.882087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77cdf-12e5-4e77-89ae-87bc98b7ef85 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:09.882369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77cdf-12e5-4e77-89ae-87bc98b7ef85 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:09.882704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b77cdf-12e5-4e77-89ae-87bc98b7ef85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:09.920995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-26b77cdf-12e5-4e77-89ae-87bc98b7ef85 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:09.922105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-26b77cdf-12e5-4e77-89ae-87bc98b7ef85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:09.977623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4ac09-4dd1-41de-9d77-d71c9e3f8cc0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:10.033772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea39f2-8c40-459d-ba3e-23da4af65159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:10.034885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea39f2-8c40-459d-ba3e-23da4af65159 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:10.035330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea39f2-8c40-459d-ba3e-23da4af65159 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:10.035761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ea39f2-8c40-459d-ba3e-23da4af65159 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:10.054274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ea39f2-8c40-459d-ba3e-23da4af65159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-23ea39f2-8c40-459d-ba3e-23da4af65159 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:10.074930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:10.076165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:10.077710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:10.079664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 50/101] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:10.085690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea39f2-8c40-459d-ba3e-23da4af65159 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:10.109295 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 52/102] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:10.161917 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4fe3-971e-4a96-844b-96bde9c17189 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:10.162561 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4fe3-971e-4a96-844b-96bde9c17189 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:10.163075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342f4fe3-971e-4a96-844b-96bde9c17189 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:10.164709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 53/103] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:10.170055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba60cb-6b4b-44b1-86dc-178d194d3ec1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:10.170920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba60cb-6b4b-44b1-86dc-178d194d3ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:10.171473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba60cb-6b4b-44b1-86dc-178d194d3ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:10.208277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4cba60cb-6b4b-44b1-86dc-178d194d3ec1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:10.209493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4cba60cb-6b4b-44b1-86dc-178d194d3ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:10.233190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:10.273658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ea39f2-8c40-459d-ba3e-23da4af65159 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:10.338063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737b752-1bc6-4932-8967-c1132ce700c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:10.339122 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737b752-1bc6-4932-8967-c1132ce700c9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:10.339628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737b752-1bc6-4932-8967-c1132ce700c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:10.340181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9737b752-1bc6-4932-8967-c1132ce700c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:10.341133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737b752-1bc6-4932-8967-c1132ce700c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:10.341836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737b752-1bc6-4932-8967-c1132ce700c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:10.344012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9737b752-1bc6-4932-8967-c1132ce700c9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:10.353397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 51/104] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:10.354442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737b752-1bc6-4932-8967-c1132ce700c9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:10.374060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 54/105] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:10.374879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba60cb-6b4b-44b1-86dc-178d194d3ec1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:10.400356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:10.492623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9737b752-1bc6-4932-8967-c1132ce700c9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:10.530492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8630e2d-d2b3-4594-b298-530f4f0bed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:10.531635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8630e2d-d2b3-4594-b298-530f4f0bed24 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:10.532150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8630e2d-d2b3-4594-b298-530f4f0bed24 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:10.532627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8630e2d-d2b3-4594-b298-530f4f0bed24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:10.534167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8630e2d-d2b3-4594-b298-530f4f0bed24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:10.535850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8630e2d-d2b3-4594-b298-530f4f0bed24 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:10.537858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 52/106] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:10.538827 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8630e2d-d2b3-4594-b298-530f4f0bed24 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:10.542892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:10.651591 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8630e2d-d2b3-4594-b298-530f4f0bed24 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:10.668504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba60cb-6b4b-44b1-86dc-178d194d3ec1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:10.690370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee7c24-23cd-43e4-99a4-a4fe448159cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:10.695949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee7c24-23cd-43e4-99a4-a4fe448159cc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:10.696519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee7c24-23cd-43e4-99a4-a4fe448159cc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:10.697114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee7c24-23cd-43e4-99a4-a4fe448159cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:10.717593 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee7c24-23cd-43e4-99a4-a4fe448159cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9dee7c24-23cd-43e4-99a4-a4fe448159cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:10.725212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:10.726048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:10.726822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:10.727398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 53/107] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:49:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:10.727958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee7c24-23cd-43e4-99a4-a4fe448159cc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:10.734171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184355d0-93b3-4a12-a794-feb8d76abc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:10.735107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184355d0-93b3-4a12-a794-feb8d76abc3b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:10.735390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184355d0-93b3-4a12-a794-feb8d76abc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:10.735705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184355d0-93b3-4a12-a794-feb8d76abc3b None admin] PATH_INFO: `/v3/users/f42b447d38c141b99e5aedea1f1b1e23` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:10.761372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184355d0-93b3-4a12-a794-feb8d76abc3b None admin] RBAC: Authorizing `identity:get_user(user_id=f42b447d38c141b99e5aedea1f1b1e23)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:10.762827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184355d0-93b3-4a12-a794-feb8d76abc3b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:10.767519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 55/108] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:10 2022] GET /identity/v3/users/f42b447d38c141b99e5aedea1f1b1e23 => generated 289 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:10.768344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184355d0-93b3-4a12-a794-feb8d76abc3b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:10.850540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:10.894523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee7c24-23cd-43e4-99a4-a4fe448159cc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:10.904808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:10.931352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f24aa-2729-4025-a7ee-d2f6489d35be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:10.932276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f24aa-2729-4025-a7ee-d2f6489d35be None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:10.934134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f24aa-2729-4025-a7ee-d2f6489d35be None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:10.935292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4f24aa-2729-4025-a7ee-d2f6489d35be None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:10.936482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f24aa-2729-4025-a7ee-d2f6489d35be None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:10.938157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4f24aa-2729-4025-a7ee-d2f6489d35be None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:10.978908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184355d0-93b3-4a12-a794-feb8d76abc3b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:11.033051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae990aa3-ffb6-424e-87a2-96f651e8368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:11.033051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990aa3-ffb6-424e-87a2-96f651e8368a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.033051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990aa3-ffb6-424e-87a2-96f651e8368a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.033051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae990aa3-ffb6-424e-87a2-96f651e8368a None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.033510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae990aa3-ffb6-424e-87a2-96f651e8368a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:11.033510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae990aa3-ffb6-424e-87a2-96f651e8368a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:11.033510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae990aa3-ffb6-424e-87a2-96f651e8368a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:11.033510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 56/109] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:11.033510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae990aa3-ffb6-424e-87a2-96f651e8368a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:11.067761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 54/110] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:49:10 2022] POST /identity/v3/projects => generated 302 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:11.072104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f24aa-2729-4025-a7ee-d2f6489d35be None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:11.156848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae990aa3-ffb6-424e-87a2-96f651e8368a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:11.188288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:11.199355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd69d5-de1c-4a12-98a9-91c692d8027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:11.202121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd69d5-de1c-4a12-98a9-91c692d8027d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.203319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd69d5-de1c-4a12-98a9-91c692d8027d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.203876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd69d5-de1c-4a12-98a9-91c692d8027d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.260706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4f24aa-2729-4025-a7ee-d2f6489d35be None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:11.285674 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:11.307720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039c69ce-237c-423e-a4d6-7c850dda12c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:11.309014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c69ce-237c-423e-a4d6-7c850dda12c8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.309312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c69ce-237c-423e-a4d6-7c850dda12c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.309598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039c69ce-237c-423e-a4d6-7c850dda12c8 None admin] PATH_INFO: `/v3/users/b412ad98326b4f4489e43e1f01737fef` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.310969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c69ce-237c-423e-a4d6-7c850dda12c8 None admin] RBAC: Authorizing `identity:get_user(user_id=b412ad98326b4f4489e43e1f01737fef)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:11.312652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039c69ce-237c-423e-a4d6-7c850dda12c8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:11.319639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 55/111] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:11 2022] GET /identity/v3/users/b412ad98326b4f4489e43e1f01737fef => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:11.319639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c9a9-0111-42a0-a8cd-e237e464daad None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.319639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c9a9-0111-42a0-a8cd-e237e464daad None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.319639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001c9a9-0111-42a0-a8cd-e237e464daad None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.319639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 56/112] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:11.325196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acde80-f2c3-4050-9cfe-3bfbd37bda20 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.325196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acde80-f2c3-4050-9cfe-3bfbd37bda20 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.325333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd69d5-de1c-4a12-98a9-91c692d8027d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:11.325401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15acde80-f2c3-4050-9cfe-3bfbd37bda20 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.325464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edd69d5-de1c-4a12-98a9-91c692d8027d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:11.325527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 57/113] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:11.325527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acde80-f2c3-4050-9cfe-3bfbd37bda20 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:11.452870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 57/114] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:11.454782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc035c-b32a-4e43-87e3-a4685bcdb17f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.455078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc035c-b32a-4e43-87e3-a4685bcdb17f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.455361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc035c-b32a-4e43-87e3-a4685bcdb17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.457876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15acde80-f2c3-4050-9cfe-3bfbd37bda20 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:11.476445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f7cc035c-b32a-4e43-87e3-a4685bcdb17f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:11.477880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f7cc035c-b32a-4e43-87e3-a4685bcdb17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:11.497006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4dd69-5c65-40e2-8496-66fd89a234a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:11.498277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4dd69-5c65-40e2-8496-66fd89a234a2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.498851 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4dd69-5c65-40e2-8496-66fd89a234a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.499393 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4dd69-5c65-40e2-8496-66fd89a234a2 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.500951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4dd69-5c65-40e2-8496-66fd89a234a2 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:11.502677 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4dd69-5c65-40e2-8496-66fd89a234a2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:11.504102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:11.504950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 58/115] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:11 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:11.511092 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420af49-a721-47b0-85ba-fad6ee0bcf37 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.511773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420af49-a721-47b0-85ba-fad6ee0bcf37 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.512276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0420af49-a721-47b0-85ba-fad6ee0bcf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.531864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0420af49-a721-47b0-85ba-fad6ee0bcf37 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:11.533458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0420af49-a721-47b0-85ba-fad6ee0bcf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:11.566359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 58/116] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:11.567511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc035c-b32a-4e43-87e3-a4685bcdb17f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:11.604928 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:11.626586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 59/117] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:11.627758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420af49-a721-47b0-85ba-fad6ee0bcf37 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:11.709486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc035c-b32a-4e43-87e3-a4685bcdb17f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:11.735322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0420af49-a721-47b0-85ba-fad6ee0bcf37 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:11.748380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83086eb-4a3a-4363-9b1e-1981be05dd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:11.749277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83086eb-4a3a-4363-9b1e-1981be05dd50 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.749554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83086eb-4a3a-4363-9b1e-1981be05dd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.749825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83086eb-4a3a-4363-9b1e-1981be05dd50 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.751044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83086eb-4a3a-4363-9b1e-1981be05dd50 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:11.752524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83086eb-4a3a-4363-9b1e-1981be05dd50 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:11.758889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 59/118] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:11 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:11.758889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83086eb-4a3a-4363-9b1e-1981be05dd50 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:11.780089 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff3ed7-b691-4fd2-9705-3b3cf2cc0399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:11.781102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff3ed7-b691-4fd2-9705-3b3cf2cc0399 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.781389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff3ed7-b691-4fd2-9705-3b3cf2cc0399 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.781662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff3ed7-b691-4fd2-9705-3b3cf2cc0399 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63/users/b412ad98326b4f4489e43e1f01737fef/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.783608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff3ed7-b691-4fd2-9705-3b3cf2cc0399 None admin] RBAC: Authorizing `identity:create_grant(project_id=37a366467c364c32b052631d9f1b6e63, user_id=b412ad98326b4f4489e43e1f01737fef, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:11.784332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:11.785111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff3ed7-b691-4fd2-9705-3b3cf2cc0399 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:11.908405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83086eb-4a3a-4363-9b1e-1981be05dd50 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:11.914182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 60/119] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:49:11 2022] PUT /identity/v3/projects/37a366467c364c32b052631d9f1b6e63/users/b412ad98326b4f4489e43e1f01737fef/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:11.915222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff3ed7-b691-4fd2-9705-3b3cf2cc0399 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:11.961182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef0f50-b260-42af-a717-df82430da274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:11.961182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef0f50-b260-42af-a717-df82430da274 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.962090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef0f50-b260-42af-a717-df82430da274 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.962374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef0f50-b260-42af-a717-df82430da274 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.970910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:11.976504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef0f50-b260-42af-a717-df82430da274 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-61ef0f50-b260-42af-a717-df82430da274 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:11.987071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:11.988029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:11.988798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:11.989375 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 60/120] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:11.990393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620a02-2b31-45f5-b37d-abbb79de65d6 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:11.990684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620a02-2b31-45f5-b37d-abbb79de65d6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:11.991337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee620a02-2b31-45f5-b37d-abbb79de65d6 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:11.992903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 61/121] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:11.996780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee620a02-2b31-45f5-b37d-abbb79de65d6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:12.042475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff3ed7-b691-4fd2-9705-3b3cf2cc0399 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:12.081308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888a9d0-90d4-47ce-b36f-8abfd71b05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:12.083075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a9d0-90d4-47ce-b36f-8abfd71b05e5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:12.083075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a9d0-90d4-47ce-b36f-8abfd71b05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:12.083075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7888a9d0-90d4-47ce-b36f-8abfd71b05e5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:12.096491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7888a9d0-90d4-47ce-b36f-8abfd71b05e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:12.102316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7888a9d0-90d4-47ce-b36f-8abfd71b05e5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:12.105590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:12.106468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:12.107797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 61/122] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:12.109763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888a9d0-90d4-47ce-b36f-8abfd71b05e5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:12.126546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee620a02-2b31-45f5-b37d-abbb79de65d6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:12.174002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab75fbd-ad97-46e6-b364-f619db03db04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:12.175296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab75fbd-ad97-46e6-b364-f619db03db04 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:12.175779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab75fbd-ad97-46e6-b364-f619db03db04 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:12.176547 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab75fbd-ad97-46e6-b364-f619db03db04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:12.178085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab75fbd-ad97-46e6-b364-f619db03db04 None admin] RBAC: Adding query filter params (role.id=a0dae20055d1456ba8d94cfec7d62668, scope.project.id=37a366467c364c32b052631d9f1b6e63, user.id=f42b447d38c141b99e5aedea1f1b1e23) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:12.178737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab75fbd-ad97-46e6-b364-f619db03db04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:12.180816 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab75fbd-ad97-46e6-b364-f619db03db04 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:12.189254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 62/123] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:11 2022] GET /identity/v3/role_assignments?user.id=f42b447d38c141b99e5aedea1f1b1e23&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=a0dae20055d1456ba8d94cfec7d62668 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:12.191158 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0834a-711f-4c18-8938-c22b8080acec None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:12.191670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0834a-711f-4c18-8938-c22b8080acec None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:12.192192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e0834a-711f-4c18-8938-c22b8080acec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:12.213272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-76e0834a-711f-4c18-8938-c22b8080acec None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:12.214880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-76e0834a-711f-4c18-8938-c22b8080acec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:12.264312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7888a9d0-90d4-47ce-b36f-8abfd71b05e5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:12.266892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:12.333083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 63/124] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:12.334123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0834a-711f-4c18-8938-c22b8080acec None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:12.360783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30224798-4c5a-4651-9e14-000260945ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:12.361484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30224798-4c5a-4651-9e14-000260945ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:12.361774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30224798-4c5a-4651-9e14-000260945ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:12.362058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30224798-4c5a-4651-9e14-000260945ad5 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:12.362840 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30224798-4c5a-4651-9e14-000260945ad5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:12.363151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30224798-4c5a-4651-9e14-000260945ad5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:12.364639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30224798-4c5a-4651-9e14-000260945ad5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:12.376929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 62/125] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:12.377869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30224798-4c5a-4651-9e14-000260945ad5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:12.432394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:12.471507 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e0834a-711f-4c18-8938-c22b8080acec None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:12.534068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703182a-f778-454a-a5ea-a5bd7ff70448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:12.535109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703182a-f778-454a-a5ea-a5bd7ff70448 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:12.535589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703182a-f778-454a-a5ea-a5bd7ff70448 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:12.536113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703182a-f778-454a-a5ea-a5bd7ff70448 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:12.537094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703182a-f778-454a-a5ea-a5bd7ff70448 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:12.537601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703182a-f778-454a-a5ea-a5bd7ff70448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:12.539189 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0703182a-f778-454a-a5ea-a5bd7ff70448 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:12.552766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 64/126] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:12.555012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30224798-4c5a-4651-9e14-000260945ad5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:12.557462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703182a-f778-454a-a5ea-a5bd7ff70448 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:12.613784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8ae8b-169f-44d8-9c00-72ddc4254311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:12.614950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8ae8b-169f-44d8-9c00-72ddc4254311 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:12.615436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8ae8b-169f-44d8-9c00-72ddc4254311 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:12.615956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8ae8b-169f-44d8-9c00-72ddc4254311 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:12.626858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8ae8b-169f-44d8-9c00-72ddc4254311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9bc8ae8b-169f-44d8-9c00-72ddc4254311 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:12.634901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:12.635791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:12.636603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:12.638990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 63/127] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:12.640025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8ae8b-169f-44d8-9c00-72ddc4254311 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:12.671305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:12.749279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703182a-f778-454a-a5ea-a5bd7ff70448 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:12.807060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8ae8b-169f-44d8-9c00-72ddc4254311 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:12.816966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcda32-bbb0-4efc-9824-cca576b9eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:12.817864 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcda32-bbb0-4efc-9824-cca576b9eee0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:12.818153 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcda32-bbb0-4efc-9824-cca576b9eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:12.818428 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebcda32-bbb0-4efc-9824-cca576b9eee0 None admin] PATH_INFO: `/v3/users/77833c08172c4aa2bc9b92c7124c3fe5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:12.819998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcda32-bbb0-4efc-9824-cca576b9eee0 None admin] RBAC: Authorizing `identity:get_user(user_id=77833c08172c4aa2bc9b92c7124c3fe5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:12.822113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebcda32-bbb0-4efc-9824-cca576b9eee0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:12.823901 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 65/128] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:12 2022] GET /identity/v3/users/77833c08172c4aa2bc9b92c7124c3fe5 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:12.834847 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcda32-bbb0-4efc-9824-cca576b9eee0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:12.849330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7528a-1edb-42cf-845d-89849723db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:12.850982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7528a-1edb-42cf-845d-89849723db76 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:12.851622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7528a-1edb-42cf-845d-89849723db76 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:12.852193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e7528a-1edb-42cf-845d-89849723db76 None admin] PATH_INFO: `/v3/users/77833c08172c4aa2bc9b92c7124c3fe5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:12.853597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7528a-1edb-42cf-845d-89849723db76 None admin] RBAC: Authorizing `identity:get_user(user_id=77833c08172c4aa2bc9b92c7124c3fe5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:12.855287 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e7528a-1edb-42cf-845d-89849723db76 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:12.855807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:12.857715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 64/129] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:12 2022] GET /identity/v3/users/77833c08172c4aa2bc9b92c7124c3fe5 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:12.858780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7528a-1edb-42cf-845d-89849723db76 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:12.954303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:12.965100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e7528a-1edb-42cf-845d-89849723db76 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:13.031278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b165f-700e-43f2-9dd0-5068116d7389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:13.032454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b165f-700e-43f2-9dd0-5068116d7389 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:13.032907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b165f-700e-43f2-9dd0-5068116d7389 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:13.033347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181b165f-700e-43f2-9dd0-5068116d7389 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:13.035542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b165f-700e-43f2-9dd0-5068116d7389 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:13.037286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181b165f-700e-43f2-9dd0-5068116d7389 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:13.040056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 65/130] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:12 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:13.041158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b165f-700e-43f2-9dd0-5068116d7389 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:13.071765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebcda32-bbb0-4efc-9824-cca576b9eee0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:13.135531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac63d7-a4d1-473e-a031-50af52f1d66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:13.136518 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac63d7-a4d1-473e-a031-50af52f1d66a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:13.139078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac63d7-a4d1-473e-a031-50af52f1d66a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:13.139556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac63d7-a4d1-473e-a031-50af52f1d66a None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:13.141798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac63d7-a4d1-473e-a031-50af52f1d66a None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:13.145409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac63d7-a4d1-473e-a031-50af52f1d66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:13.147036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ac63d7-a4d1-473e-a031-50af52f1d66a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:13.163004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 66/131] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:13.164121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac63d7-a4d1-473e-a031-50af52f1d66a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:13.244946 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181b165f-700e-43f2-9dd0-5068116d7389 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:13.315968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fc101-3afd-471b-9978-ce7445854ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:13.316372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:13.317231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fc101-3afd-471b-9978-ce7445854ff0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:13.317583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fc101-3afd-471b-9978-ce7445854ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:13.317866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fc101-3afd-471b-9978-ce7445854ff0 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:13.320906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fc101-3afd-471b-9978-ce7445854ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:13.322383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fc101-3afd-471b-9978-ce7445854ff0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:13.324111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 66/132] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:13 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:13.324874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fc101-3afd-471b-9978-ce7445854ff0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:13.360328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:13.398121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ac63d7-a4d1-473e-a031-50af52f1d66a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:13.428661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fc101-3afd-471b-9978-ce7445854ff0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:13.464099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f820eb3-6458-4629-90c5-c44809760cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:13.464982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820eb3-6458-4629-90c5-c44809760cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:13.465262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820eb3-6458-4629-90c5-c44809760cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:13.465532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f820eb3-6458-4629-90c5-c44809760cc0 None admin] PATH_INFO: `/v3/users/77833c08172c4aa2bc9b92c7124c3fe5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:13.466826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f820eb3-6458-4629-90c5-c44809760cc0 None admin] RBAC: Authorizing `identity:get_user(user_id=77833c08172c4aa2bc9b92c7124c3fe5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:13.468320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f820eb3-6458-4629-90c5-c44809760cc0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:13.469979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 67/133] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:13 2022] GET /identity/v3/users/77833c08172c4aa2bc9b92c7124c3fe5 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:13.470734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f820eb3-6458-4629-90c5-c44809760cc0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:13.485856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103233a-4a3c-4005-ad25-5f21dc119da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:13.487137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103233a-4a3c-4005-ad25-5f21dc119da4 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:13.487622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103233a-4a3c-4005-ad25-5f21dc119da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:13.488122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0103233a-4a3c-4005-ad25-5f21dc119da4 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63/users/77833c08172c4aa2bc9b92c7124c3fe5/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:13.492551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103233a-4a3c-4005-ad25-5f21dc119da4 None admin] RBAC: Authorizing `identity:create_grant(project_id=37a366467c364c32b052631d9f1b6e63, user_id=77833c08172c4aa2bc9b92c7124c3fe5, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:13.494041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0103233a-4a3c-4005-ad25-5f21dc119da4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:13.577904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:13.583908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f820eb3-6458-4629-90c5-c44809760cc0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:13.620679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1558c-08f9-4460-ada1-e2f375631db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:13.621581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1558c-08f9-4460-ada1-e2f375631db2 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:13.621866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1558c-08f9-4460-ada1-e2f375631db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:13.622140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1558c-08f9-4460-ada1-e2f375631db2 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63/users/77833c08172c4aa2bc9b92c7124c3fe5/roles/5b16ed690a6942c288df268569b6ab85` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:13.624945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1558c-08f9-4460-ada1-e2f375631db2 None admin] RBAC: Authorizing `identity:create_grant(project_id=37a366467c364c32b052631d9f1b6e63, user_id=77833c08172c4aa2bc9b92c7124c3fe5, role_id=5b16ed690a6942c288df268569b6ab85)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:13.628419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1558c-08f9-4460-ada1-e2f375631db2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:13.636014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 67/134] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:49:13 2022] PUT /identity/v3/projects/37a366467c364c32b052631d9f1b6e63/users/77833c08172c4aa2bc9b92c7124c3fe5/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:13.637177 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103233a-4a3c-4005-ad25-5f21dc119da4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:13.745372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 68/135] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:49:13 2022] PUT /identity/v3/projects/37a366467c364c32b052631d9f1b6e63/users/77833c08172c4aa2bc9b92c7124c3fe5/roles/5b16ed690a6942c288df268569b6ab85 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:13.749613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a99098-5ace-4c78-91f3-ff0cf9e1d2fe None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:13.749930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a99098-5ace-4c78-91f3-ff0cf9e1d2fe None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:13.750177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a99098-5ace-4c78-91f3-ff0cf9e1d2fe None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:13.755649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 69/136] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:13.760482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6389cf-e856-4846-b17a-1adf222069f9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:13.760765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6389cf-e856-4846-b17a-1adf222069f9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:13.761119 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6389cf-e856-4846-b17a-1adf222069f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:13.799086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0103233a-4a3c-4005-ad25-5f21dc119da4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:13.803975 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3a6389cf-e856-4846-b17a-1adf222069f9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:13.806915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3a6389cf-e856-4846-b17a-1adf222069f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:13.864152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:13.872384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58b0ac-28c6-4b4d-84f2-465004ecf197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:13.874606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58b0ac-28c6-4b4d-84f2-465004ecf197 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:13.875091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58b0ac-28c6-4b4d-84f2-465004ecf197 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:13.883686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f58b0ac-28c6-4b4d-84f2-465004ecf197 None admin] PATH_INFO: `/v3/projects/9a20c633c43047a19da99ed7d4330943` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:13.883686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58b0ac-28c6-4b4d-84f2-465004ecf197 None admin] RBAC: Authorizing `identity:get_project(project_id=9a20c633c43047a19da99ed7d4330943)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:13.883686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f58b0ac-28c6-4b4d-84f2-465004ecf197 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:13.883686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 68/137] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:13 2022] GET /identity/v3/projects/9a20c633c43047a19da99ed7d4330943 => generated 312 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:13.888687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58b0ac-28c6-4b4d-84f2-465004ecf197 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:13.922450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 70/138] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:13.964892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6389cf-e856-4846-b17a-1adf222069f9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:14.070185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f58b0ac-28c6-4b4d-84f2-465004ecf197 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:14.107943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:14.113522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116063a6-b997-4004-8b01-0ff222723d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:14.114485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116063a6-b997-4004-8b01-0ff222723d8b None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:14.114713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116063a6-b997-4004-8b01-0ff222723d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:14.114987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116063a6-b997-4004-8b01-0ff222723d8b None admin] PATH_INFO: `/v3/projects/9a20c633c43047a19da99ed7d4330943/users/77833c08172c4aa2bc9b92c7124c3fe5/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:14.118407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116063a6-b997-4004-8b01-0ff222723d8b None admin] RBAC: Authorizing `identity:create_grant(project_id=9a20c633c43047a19da99ed7d4330943, user_id=77833c08172c4aa2bc9b92c7124c3fe5, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:14.119874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116063a6-b997-4004-8b01-0ff222723d8b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:14.133589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6389cf-e856-4846-b17a-1adf222069f9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:14.183709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93ff9-75b9-44eb-9c52-17dcc6719e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:14.184878 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93ff9-75b9-44eb-9c52-17dcc6719e00 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:14.185586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93ff9-75b9-44eb-9c52-17dcc6719e00 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:14.186167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a93ff9-75b9-44eb-9c52-17dcc6719e00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:14.187853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a93ff9-75b9-44eb-9c52-17dcc6719e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:14.189542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a93ff9-75b9-44eb-9c52-17dcc6719e00 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:14.191850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 71/139] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:14.197659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93ff9-75b9-44eb-9c52-17dcc6719e00 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:14.236212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 69/140] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:49:13 2022] PUT /identity/v3/projects/9a20c633c43047a19da99ed7d4330943/users/77833c08172c4aa2bc9b92c7124c3fe5/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:14.364570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a93ff9-75b9-44eb-9c52-17dcc6719e00 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:14.421128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bb091-4428-40d5-9b88-144b1199295c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:14.421816 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bb091-4428-40d5-9b88-144b1199295c None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:14.422093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bb091-4428-40d5-9b88-144b1199295c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:14.422398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bb091-4428-40d5-9b88-144b1199295c None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:14.423090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bb091-4428-40d5-9b88-144b1199295c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:14.424626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bb091-4428-40d5-9b88-144b1199295c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:14.452993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441a53a-0e8d-4c59-9783-e5a18956b514 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:14.453296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441a53a-0e8d-4c59-9783-e5a18956b514 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:14.453553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441a53a-0e8d-4c59-9783-e5a18956b514 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:14.454948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 70/141] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:14.472848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1ea5-34e0-4ad8-9a21-ef918a6caa6c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:14.473146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1ea5-34e0-4ad8-9a21-ef918a6caa6c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:14.473403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aa1ea5-34e0-4ad8-9a21-ef918a6caa6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:14.499401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a1aa1ea5-34e0-4ad8-9a21-ef918a6caa6c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:14.500706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a1aa1ea5-34e0-4ad8-9a21-ef918a6caa6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:14.535842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 72/142] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:14 2022] POST /identity/v3/users => generated 283 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 21:49:14.579217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:14.599097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 71/143] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:14.645239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bb091-4428-40d5-9b88-144b1199295c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:14.661555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:14.779652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bb091-4428-40d5-9b88-144b1199295c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:14.816221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc091a4d-d02b-4e3c-85a8-040e716fc5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:14.817016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091a4d-d02b-4e3c-85a8-040e716fc5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:14.817295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091a4d-d02b-4e3c-85a8-040e716fc5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:14.817561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc091a4d-d02b-4e3c-85a8-040e716fc5b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:14.828952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc091a4d-d02b-4e3c-85a8-040e716fc5b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cc091a4d-d02b-4e3c-85a8-040e716fc5b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:14.836675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:14.837556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:14.838308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 73/144] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:49:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:14.845209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1ea5-34e0-4ad8-9a21-ef918a6caa6c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:14.947273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aa1ea5-34e0-4ad8-9a21-ef918a6caa6c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:14.984425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf20c547-e6c2-4878-b4ab-243e291e632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:14.985095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20c547-e6c2-4878-b4ab-243e291e632d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:14.985376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20c547-e6c2-4878-b4ab-243e291e632d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:14.985649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf20c547-e6c2-4878-b4ab-243e291e632d None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:14.986404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20c547-e6c2-4878-b4ab-243e291e632d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:14.986716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20c547-e6c2-4878-b4ab-243e291e632d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:14.988287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf20c547-e6c2-4878-b4ab-243e291e632d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:14.997615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 72/145] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:15.004131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc091a4d-d02b-4e3c-85a8-040e716fc5b0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:15.082712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d912692-8f8c-4474-bd39-890fbf28ca6e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:15.083021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d912692-8f8c-4474-bd39-890fbf28ca6e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:15.083277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d912692-8f8c-4474-bd39-890fbf28ca6e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:15.084662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 73/146] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:15.090897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24fae4-1a19-4405-aa2a-6adda5b81943 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:15.091186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24fae4-1a19-4405-aa2a-6adda5b81943 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:15.091526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b24fae4-1a19-4405-aa2a-6adda5b81943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:15.108286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:15.116598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4b24fae4-1a19-4405-aa2a-6adda5b81943 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:15.123492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4b24fae4-1a19-4405-aa2a-6adda5b81943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:15.151775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc091a4d-d02b-4e3c-85a8-040e716fc5b0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:15.172348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:15.197051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 74/147] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 21:49:15.219872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24fae4-1a19-4405-aa2a-6adda5b81943 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:15.235062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05a77c-fad0-4038-aaef-8c7e8edba14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:15.235969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05a77c-fad0-4038-aaef-8c7e8edba14c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:15.236255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05a77c-fad0-4038-aaef-8c7e8edba14c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:15.236526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05a77c-fad0-4038-aaef-8c7e8edba14c None admin] PATH_INFO: `/v3/users/b412ad98326b4f4489e43e1f01737fef` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:15.240660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05a77c-fad0-4038-aaef-8c7e8edba14c None admin] RBAC: Authorizing `identity:get_user(user_id=b412ad98326b4f4489e43e1f01737fef)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:15.242166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05a77c-fad0-4038-aaef-8c7e8edba14c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:15.243837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 74/148] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:15 2022] GET /identity/v3/users/b412ad98326b4f4489e43e1f01737fef => generated 247 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:15.261318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05a77c-fad0-4038-aaef-8c7e8edba14c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:15.330463 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b24fae4-1a19-4405-aa2a-6adda5b81943 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:15.367386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccfd28-4408-4aa6-af31-acf397c9738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:15.368317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccfd28-4408-4aa6-af31-acf397c9738f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:15.368644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccfd28-4408-4aa6-af31-acf397c9738f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:15.368914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccfd28-4408-4aa6-af31-acf397c9738f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:15.380079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccfd28-4408-4aa6-af31-acf397c9738f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-05ccfd28-4408-4aa6-af31-acf397c9738f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:15.387834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:15.389563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:15.390630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 75/149] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:15.395453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccfd28-4408-4aa6-af31-acf397c9738f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:15.445001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:15.509421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccfd28-4408-4aa6-af31-acf397c9738f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:15.534009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05a77c-fad0-4038-aaef-8c7e8edba14c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:15.549764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0187dc-6b31-4784-814e-6fe63a911b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:15.550487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0187dc-6b31-4784-814e-6fe63a911b7a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:15.550774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0187dc-6b31-4784-814e-6fe63a911b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:15.551045 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0187dc-6b31-4784-814e-6fe63a911b7a None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:15.552234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0187dc-6b31-4784-814e-6fe63a911b7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:15.552541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0187dc-6b31-4784-814e-6fe63a911b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:15.553939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0187dc-6b31-4784-814e-6fe63a911b7a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:15.564726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 76/150] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:15.569900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0187dc-6b31-4784-814e-6fe63a911b7a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:15.652664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d543f-aea0-4693-91e0-ea86563826a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:15.653345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d543f-aea0-4693-91e0-ea86563826a9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:15.653632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d543f-aea0-4693-91e0-ea86563826a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:15.654736 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d543f-aea0-4693-91e0-ea86563826a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:15.677115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:15.684928 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0187dc-6b31-4784-814e-6fe63a911b7a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:15.688251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:15.723624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe6462-f51e-4485-a720-6ea5a437f99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:15.724529 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe6462-f51e-4485-a720-6ea5a437f99c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:15.725143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe6462-f51e-4485-a720-6ea5a437f99c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:15.725425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe6462-f51e-4485-a720-6ea5a437f99c None admin] PATH_INFO: `/v3/users/f42b447d38c141b99e5aedea1f1b1e23` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:15.726772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe6462-f51e-4485-a720-6ea5a437f99c None admin] RBAC: Authorizing `identity:get_user(user_id=f42b447d38c141b99e5aedea1f1b1e23)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:15.730088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe6462-f51e-4485-a720-6ea5a437f99c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:15.733228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 77/151] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:15 2022] GET /identity/v3/users/f42b447d38c141b99e5aedea1f1b1e23 => generated 289 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:15.736815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe6462-f51e-4485-a720-6ea5a437f99c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:15.854605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe6462-f51e-4485-a720-6ea5a437f99c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:15.872829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d543f-aea0-4693-91e0-ea86563826a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:15.874508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d543f-aea0-4693-91e0-ea86563826a9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:15.895726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b248e-88a4-4b61-a7ca-b586443511ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:15.896623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b248e-88a4-4b61-a7ca-b586443511ed None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:15.896904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b248e-88a4-4b61-a7ca-b586443511ed None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:15.897176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1b248e-88a4-4b61-a7ca-b586443511ed None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:15.898521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b248e-88a4-4b61-a7ca-b586443511ed None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:15.900392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1b248e-88a4-4b61-a7ca-b586443511ed None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:15.904682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 78/152] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:15 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:15.909159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b248e-88a4-4b61-a7ca-b586443511ed None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:15.968410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:16.022458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1b248e-88a4-4b61-a7ca-b586443511ed None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:16.067544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5e911-c48d-4934-a011-41cfb7aae6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:16.068478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5e911-c48d-4934-a011-41cfb7aae6a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:16.068856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5e911-c48d-4934-a011-41cfb7aae6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:16.069176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5e911-c48d-4934-a011-41cfb7aae6a2 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63/users/f42b447d38c141b99e5aedea1f1b1e23/roles/a0dae20055d1456ba8d94cfec7d62668` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:16.071398 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5e911-c48d-4934-a011-41cfb7aae6a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=37a366467c364c32b052631d9f1b6e63, user_id=f42b447d38c141b99e5aedea1f1b1e23, role_id=a0dae20055d1456ba8d94cfec7d62668)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:16.072992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d5e911-c48d-4934-a011-41cfb7aae6a2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:16.097783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 75/153] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 837 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:16.103476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d543f-aea0-4693-91e0-ea86563826a9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:16.153811 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 79/154] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:49:15 2022] PUT /identity/v3/projects/37a366467c364c32b052631d9f1b6e63/users/f42b447d38c141b99e5aedea1f1b1e23/roles/a0dae20055d1456ba8d94cfec7d62668 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 21:49:16.161554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:16.229650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d543f-aea0-4693-91e0-ea86563826a9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:16.282133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed59c98f-2688-4f66-9202-11d318027e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:16.283018 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59c98f-2688-4f66-9202-11d318027e55 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:16.283298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59c98f-2688-4f66-9202-11d318027e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:16.283571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed59c98f-2688-4f66-9202-11d318027e55 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:16.284857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59c98f-2688-4f66-9202-11d318027e55 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:16.286395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed59c98f-2688-4f66-9202-11d318027e55 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:16.288626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 76/155] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:16 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:16.294363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5e911-c48d-4934-a011-41cfb7aae6a2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:16.444225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d5e911-c48d-4934-a011-41cfb7aae6a2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:16.453286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:16.485316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193f4c0-c10f-4559-a1bc-8ac5b09b8077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:16.485984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f4c0-c10f-4559-a1bc-8ac5b09b8077 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:16.486310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f4c0-c10f-4559-a1bc-8ac5b09b8077 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:16.486584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193f4c0-c10f-4559-a1bc-8ac5b09b8077 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:16.487430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193f4c0-c10f-4559-a1bc-8ac5b09b8077 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=37a366467c364c32b052631d9f1b6e63, user.id=b412ad98326b4f4489e43e1f01737fef) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:16.487734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193f4c0-c10f-4559-a1bc-8ac5b09b8077 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:16.489262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193f4c0-c10f-4559-a1bc-8ac5b09b8077 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:16.496274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 80/156] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:16 2022] GET /identity/v3/role_assignments?user.id=b412ad98326b4f4489e43e1f01737fef&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:16.528275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154b270-e964-436c-a128-913b18522082 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:16.528621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154b270-e964-436c-a128-913b18522082 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:16.529111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9154b270-e964-436c-a128-913b18522082 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:16.531516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 77/157] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:16.537444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c7083-be30-4b3e-8723-9312d37d29d4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:16.537742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c7083-be30-4b3e-8723-9312d37d29d4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:16.538063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c7083-be30-4b3e-8723-9312d37d29d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:16.558216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-124c7083-be30-4b3e-8723-9312d37d29d4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:16.559538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-124c7083-be30-4b3e-8723-9312d37d29d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:16.646537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 81/158] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:16.679507 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154b270-e964-436c-a128-913b18522082 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:16.820039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9154b270-e964-436c-a128-913b18522082 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:16.829540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:16.861121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ab1c6-4895-42fe-b83f-7d033c6e20bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:16.862283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ab1c6-4895-42fe-b83f-7d033c6e20bd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:16.862760 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ab1c6-4895-42fe-b83f-7d033c6e20bd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:16.863227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ab1c6-4895-42fe-b83f-7d033c6e20bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:16.878589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ab1c6-4895-42fe-b83f-7d033c6e20bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-322ab1c6-4895-42fe-b83f-7d033c6e20bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:16.894036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:16.894969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:16.895866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:16.898416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 78/159] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:16.905580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c7083-be30-4b3e-8723-9312d37d29d4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:17.024389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:17.032267 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c7083-be30-4b3e-8723-9312d37d29d4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:17.077049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55725f-9cf5-4367-b6f0-306e3da78cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:17.077617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55725f-9cf5-4367-b6f0-306e3da78cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:17.077897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55725f-9cf5-4367-b6f0-306e3da78cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:17.078173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55725f-9cf5-4367-b6f0-306e3da78cd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:17.078929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55725f-9cf5-4367-b6f0-306e3da78cd7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:17.079236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55725f-9cf5-4367-b6f0-306e3da78cd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:17.080661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd55725f-9cf5-4367-b6f0-306e3da78cd7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:17.095599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 82/160] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:17.101709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ab1c6-4895-42fe-b83f-7d033c6e20bd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:17.255805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ab1c6-4895-42fe-b83f-7d033c6e20bd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:17.296588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd9d29f-78cc-41f7-93db-273992cff3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:17.297835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9d29f-78cc-41f7-93db-273992cff3ec None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:17.298319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9d29f-78cc-41f7-93db-273992cff3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:17.298790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd9d29f-78cc-41f7-93db-273992cff3ec None admin] PATH_INFO: `/v3/users/77833c08172c4aa2bc9b92c7124c3fe5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:17.304629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9d29f-78cc-41f7-93db-273992cff3ec None admin] RBAC: Authorizing `identity:get_user(user_id=77833c08172c4aa2bc9b92c7124c3fe5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:17.306345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd9d29f-78cc-41f7-93db-273992cff3ec None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:17.308277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 79/161] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:17 2022] GET /identity/v3/users/77833c08172c4aa2bc9b92c7124c3fe5 => generated 275 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:17.314576 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55725f-9cf5-4367-b6f0-306e3da78cd7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:17.473256 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81045c06-35da-4b53-ba69-77f3dc50b8d5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:17.473914 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81045c06-35da-4b53-ba69-77f3dc50b8d5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:17.474424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81045c06-35da-4b53-ba69-77f3dc50b8d5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:17.476282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 80/162] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:17.481128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf42d34-d94d-486b-98ff-456d792274ca None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:17.481643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf42d34-d94d-486b-98ff-456d792274ca None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:17.482664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf42d34-d94d-486b-98ff-456d792274ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:17.491374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd55725f-9cf5-4367-b6f0-306e3da78cd7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:17.525036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fcf42d34-d94d-486b-98ff-456d792274ca None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:17.526617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fcf42d34-d94d-486b-98ff-456d792274ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:17.557986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f81ce1-3a84-4e9b-b99a-8c4c57c7db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:17.558655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f81ce1-3a84-4e9b-b99a-8c4c57c7db4b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:17.558954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f81ce1-3a84-4e9b-b99a-8c4c57c7db4b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:17.559204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f81ce1-3a84-4e9b-b99a-8c4c57c7db4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:17.590570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:17.608304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:17.701941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 81/163] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:17.703308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea600c3c-b25b-4840-a2e2-763e6e2cb987 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:17.703601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea600c3c-b25b-4840-a2e2-763e6e2cb987 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:17.703879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea600c3c-b25b-4840-a2e2-763e6e2cb987 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:17.705347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 82/164] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:17.710307 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845ad2f-0bb2-4234-9705-97bb17f18a22 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:17.710600 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845ad2f-0bb2-4234-9705-97bb17f18a22 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:17.710887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f845ad2f-0bb2-4234-9705-97bb17f18a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:17.713066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f81ce1-3a84-4e9b-b99a-8c4c57c7db4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:17.714545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f81ce1-3a84-4e9b-b99a-8c4c57c7db4b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:17.749846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f845ad2f-0bb2-4234-9705-97bb17f18a22 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:17.751006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f845ad2f-0bb2-4234-9705-97bb17f18a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:17.883710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 83/165] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:17.884386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845ad2f-0bb2-4234-9705-97bb17f18a22 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:17.900898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 83/166] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:17.907020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f81ce1-3a84-4e9b-b99a-8c4c57c7db4b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:17.995673 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:18.077569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:18.081440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f81ce1-3a84-4e9b-b99a-8c4c57c7db4b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:18.095235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f845ad2f-0bb2-4234-9705-97bb17f18a22 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:18.133786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf28a25-b278-4320-bac4-c07cd7c33f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:18.134658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf28a25-b278-4320-bac4-c07cd7c33f7f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:18.134947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf28a25-b278-4320-bac4-c07cd7c33f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:18.135262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf28a25-b278-4320-bac4-c07cd7c33f7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:18.151306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf28a25-b278-4320-bac4-c07cd7c33f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:18.156677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3b1fb-3596-4f31-b804-0b24175787ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:18.157896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b1fb-3596-4f31-b804-0b24175787ff None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:18.158385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b1fb-3596-4f31-b804-0b24175787ff None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:18.158842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3b1fb-3596-4f31-b804-0b24175787ff None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:18.160398 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3b1fb-3596-4f31-b804-0b24175787ff None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5cf28a25-b278-4320-bac4-c07cd7c33f7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:18.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:18.161599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 84/167] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:18.162941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf28a25-b278-4320-bac4-c07cd7c33f7f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:18.165451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f3b1fb-3596-4f31-b804-0b24175787ff None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:18.173526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 84/168] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:17 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:18.174788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3b1fb-3596-4f31-b804-0b24175787ff None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:18.279962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf28a25-b278-4320-bac4-c07cd7c33f7f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:18.316237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af0ff4-4551-4041-a5fa-0215600ce1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:18.317087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af0ff4-4551-4041-a5fa-0215600ce1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:18.317482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af0ff4-4551-4041-a5fa-0215600ce1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:18.317766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af0ff4-4551-4041-a5fa-0215600ce1e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:18.329681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af0ff4-4551-4041-a5fa-0215600ce1e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-01af0ff4-4551-4041-a5fa-0215600ce1e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:18.337678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:18.338553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:18.339399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 85/169] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:18.340070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af0ff4-4551-4041-a5fa-0215600ce1e9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:18.360277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:18.383804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3b1fb-3596-4f31-b804-0b24175787ff None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:18.426151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:18.450206 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af0ff4-4551-4041-a5fa-0215600ce1e9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:18.452708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd481d-6a11-421c-9e85-c91d972a4d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:18.453416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd481d-6a11-421c-9e85-c91d972a4d71 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:18.453687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd481d-6a11-421c-9e85-c91d972a4d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:18.454696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd481d-6a11-421c-9e85-c91d972a4d71 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:18.454696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd481d-6a11-421c-9e85-c91d972a4d71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:18.455023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd481d-6a11-421c-9e85-c91d972a4d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:18.456445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd481d-6a11-421c-9e85-c91d972a4d71 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:18.471630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 85/170] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:18.472629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd481d-6a11-421c-9e85-c91d972a4d71 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:18.488793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740eb107-d361-4042-b0b8-517c98301a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:18.489706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740eb107-d361-4042-b0b8-517c98301a6f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:18.490153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740eb107-d361-4042-b0b8-517c98301a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:18.490573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740eb107-d361-4042-b0b8-517c98301a6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:18.491620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740eb107-d361-4042-b0b8-517c98301a6f None admin] RBAC: Adding query filter params (role.id=5b16ed690a6942c288df268569b6ab85, scope.project.id=37a366467c364c32b052631d9f1b6e63, user.id=77833c08172c4aa2bc9b92c7124c3fe5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:18.492131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740eb107-d361-4042-b0b8-517c98301a6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:18.493908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740eb107-d361-4042-b0b8-517c98301a6f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:18.501503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 86/171] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:18 2022] GET /identity/v3/role_assignments?user.id=77833c08172c4aa2bc9b92c7124c3fe5&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=5b16ed690a6942c288df268569b6ab85 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:18.502478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740eb107-d361-4042-b0b8-517c98301a6f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:18.620409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:18.632400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740eb107-d361-4042-b0b8-517c98301a6f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:18.662680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd481d-6a11-421c-9e85-c91d972a4d71 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:18.705361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe9750-5c37-4420-9759-df1aa00ab831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:18.706247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe9750-5c37-4420-9759-df1aa00ab831 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:18.706532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe9750-5c37-4420-9759-df1aa00ab831 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:18.706811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe9750-5c37-4420-9759-df1aa00ab831 None admin] PATH_INFO: `/v3/users/77833c08172c4aa2bc9b92c7124c3fe5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:18.708250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe9750-5c37-4420-9759-df1aa00ab831 None admin] RBAC: Authorizing `identity:get_user(user_id=77833c08172c4aa2bc9b92c7124c3fe5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:18.709730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe9750-5c37-4420-9759-df1aa00ab831 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:18.716004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 87/172] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:18 2022] GET /identity/v3/users/77833c08172c4aa2bc9b92c7124c3fe5 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:18.717207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe9750-5c37-4420-9759-df1aa00ab831 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:18.741587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba3eb-b9df-4dc2-8e78-5e9826d3e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:18.742270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba3eb-b9df-4dc2-8e78-5e9826d3e412 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:18.742560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba3eb-b9df-4dc2-8e78-5e9826d3e412 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:18.742839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ba3eb-b9df-4dc2-8e78-5e9826d3e412 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:18.743608 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba3eb-b9df-4dc2-8e78-5e9826d3e412 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:18.743932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba3eb-b9df-4dc2-8e78-5e9826d3e412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:18.745348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ba3eb-b9df-4dc2-8e78-5e9826d3e412 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:18.759736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 86/173] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:18.765643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba3eb-b9df-4dc2-8e78-5e9826d3e412 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:18.844299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:18.932360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ba3eb-b9df-4dc2-8e78-5e9826d3e412 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:18.938373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe9750-5c37-4420-9759-df1aa00ab831 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:19.025678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a6db1-ea74-4b72-addc-fa9a8b64ba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:19.026563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a6db1-ea74-4b72-addc-fa9a8b64ba11 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.026848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a6db1-ea74-4b72-addc-fa9a8b64ba11 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.027125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a6db1-ea74-4b72-addc-fa9a8b64ba11 None admin] PATH_INFO: `/v3/users/77833c08172c4aa2bc9b92c7124c3fe5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.028936 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a6db1-ea74-4b72-addc-fa9a8b64ba11 None admin] RBAC: Authorizing `identity:get_user(user_id=77833c08172c4aa2bc9b92c7124c3fe5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:19.030763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a6db1-ea74-4b72-addc-fa9a8b64ba11 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:19.032678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 87/174] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:18 2022] GET /identity/v3/users/77833c08172c4aa2bc9b92c7124c3fe5 => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:19.037281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322dbf5c-91ae-49a8-a180-6c56b84a78e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:19.037958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dbf5c-91ae-49a8-a180-6c56b84a78e4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.038247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dbf5c-91ae-49a8-a180-6c56b84a78e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.038522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322dbf5c-91ae-49a8-a180-6c56b84a78e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.045252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a6db1-ea74-4b72-addc-fa9a8b64ba11 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:19.076468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:19.205270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dbf5c-91ae-49a8-a180-6c56b84a78e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:19.206687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322dbf5c-91ae-49a8-a180-6c56b84a78e4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:19.282328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a6db1-ea74-4b72-addc-fa9a8b64ba11 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:19.305485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:19.348030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969c70f-6c8e-4f0e-9397-a100c81d1a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:19.349227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969c70f-6c8e-4f0e-9397-a100c81d1a80 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.350594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969c70f-6c8e-4f0e-9397-a100c81d1a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.351115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969c70f-6c8e-4f0e-9397-a100c81d1a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.426919 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 88/175] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 710 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:19.429430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11cd03-8b90-423e-b278-b8cf1ba017b5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.431067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11cd03-8b90-423e-b278-b8cf1ba017b5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.432295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab11cd03-8b90-423e-b278-b8cf1ba017b5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.434476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 89/176] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:19.435614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11cd03-8b90-423e-b278-b8cf1ba017b5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:19.453251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969c70f-6c8e-4f0e-9397-a100c81d1a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:19.455059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969c70f-6c8e-4f0e-9397-a100c81d1a80 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:19.511550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:19.570493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab11cd03-8b90-423e-b278-b8cf1ba017b5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:19.600495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 88/177] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 556 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 21:49:19.602570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd247-6b6f-4272-b93b-1ebd78b31d63 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.602857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd247-6b6f-4272-b93b-1ebd78b31d63 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.603131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd247-6b6f-4272-b93b-1ebd78b31d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.611053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e64969a-55fc-4392-a245-179ae15d088f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:19.612270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64969a-55fc-4392-a245-179ae15d088f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.612751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64969a-55fc-4392-a245-179ae15d088f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.613219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e64969a-55fc-4392-a245-179ae15d088f None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.614703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64969a-55fc-4392-a245-179ae15d088f None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:19.616452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e64969a-55fc-4392-a245-179ae15d088f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:19.618453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 90/178] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:19 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:19.620068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2745-fa86-488f-8769-e7d2ce1bef19 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.620593 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2745-fa86-488f-8769-e7d2ce1bef19 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.620811 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-cd1fd247-6b6f-4272-b93b-1ebd78b31d63 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:19.621287 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed2745-fa86-488f-8769-e7d2ce1bef19 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.621988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cd1fd247-6b6f-4272-b93b-1ebd78b31d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:19.623080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 91/179] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:19.624103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed2745-fa86-488f-8769-e7d2ce1bef19 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:19.639538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:19.716955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 89/180] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:19.717853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fd247-6b6f-4272-b93b-1ebd78b31d63 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:19.749888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed2745-fa86-488f-8769-e7d2ce1bef19 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:19.765548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:19.786524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc52d3-0c4f-4e3d-990c-1a3916d865ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:19.787394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc52d3-0c4f-4e3d-990c-1a3916d865ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.787707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc52d3-0c4f-4e3d-990c-1a3916d865ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.788162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc52d3-0c4f-4e3d-990c-1a3916d865ed None admin] PATH_INFO: `/v3/projects/9a20c633c43047a19da99ed7d4330943` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.789360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc52d3-0c4f-4e3d-990c-1a3916d865ed None admin] RBAC: Authorizing `identity:get_project(project_id=9a20c633c43047a19da99ed7d4330943)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:19.790837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc52d3-0c4f-4e3d-990c-1a3916d865ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:19.797738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 92/181] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:19 2022] GET /identity/v3/projects/9a20c633c43047a19da99ed7d4330943 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:19.802684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527aac-aaa8-44c4-b67c-2056fcb6f745 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.802684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527aac-aaa8-44c4-b67c-2056fcb6f745 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.802684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527aac-aaa8-44c4-b67c-2056fcb6f745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.818737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-60527aac-aaa8-44c4-b67c-2056fcb6f745 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:19.820048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-60527aac-aaa8-44c4-b67c-2056fcb6f745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:19.827030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fd247-6b6f-4272-b93b-1ebd78b31d63 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:19.863196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16a177-9cd2-4366-a5f1-0ab307fb7d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:19.864029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16a177-9cd2-4366-a5f1-0ab307fb7d36 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.864315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16a177-9cd2-4366-a5f1-0ab307fb7d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.864590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16a177-9cd2-4366-a5f1-0ab307fb7d36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.865549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16a177-9cd2-4366-a5f1-0ab307fb7d36 None admin] RBAC: Adding query filter params (role.id=36dde009f57f45dd9ded880f26a9b2cc, scope.project.id=37a366467c364c32b052631d9f1b6e63, user.id=77833c08172c4aa2bc9b92c7124c3fe5) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:19.865862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16a177-9cd2-4366-a5f1-0ab307fb7d36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:19.867334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16a177-9cd2-4366-a5f1-0ab307fb7d36 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:19.882301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 90/182] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:19 2022] GET /identity/v3/role_assignments?user.id=77833c08172c4aa2bc9b92c7124c3fe5&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:19.882301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c340f6-e72a-4ad9-a778-fb6829d4ebcc None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:19.882301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c340f6-e72a-4ad9-a778-fb6829d4ebcc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:19.882301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c340f6-e72a-4ad9-a778-fb6829d4ebcc None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:19.882301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 91/183] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:19.882301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c340f6-e72a-4ad9-a778-fb6829d4ebcc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:19.894528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:19.899751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 93/184] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:19.901066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60527aac-aaa8-44c4-b67c-2056fcb6f745 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:20.031746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60527aac-aaa8-44c4-b67c-2056fcb6f745 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:20.051770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:20.055434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c340f6-e72a-4ad9-a778-fb6829d4ebcc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:20.077686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0bdd53-de0f-49f4-a8ed-65d1d77ac551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:20.078344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bdd53-de0f-49f4-a8ed-65d1d77ac551 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.078620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bdd53-de0f-49f4-a8ed-65d1d77ac551 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.078885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0bdd53-de0f-49f4-a8ed-65d1d77ac551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.079720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bdd53-de0f-49f4-a8ed-65d1d77ac551 None admin] RBAC: Adding query filter params (role.id=36dde009f57f45dd9ded880f26a9b2cc, scope.project.id=9a20c633c43047a19da99ed7d4330943, user.id=77833c08172c4aa2bc9b92c7124c3fe5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:20.080333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bdd53-de0f-49f4-a8ed-65d1d77ac551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:20.081818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0bdd53-de0f-49f4-a8ed-65d1d77ac551 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:20.090899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 94/185] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:19 2022] GET /identity/v3/role_assignments?user.id=77833c08172c4aa2bc9b92c7124c3fe5&scope.project.id=9a20c633c43047a19da99ed7d4330943&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:20.090899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c0c8b-0200-40bc-9d66-5c092847a91b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.090899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c0c8b-0200-40bc-9d66-5c092847a91b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.090899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0c0c8b-0200-40bc-9d66-5c092847a91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.108666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1885b-5e25-4066-9f50-24f37f2682c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:20.109486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1885b-5e25-4066-9f50-24f37f2682c8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.109766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1885b-5e25-4066-9f50-24f37f2682c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.110040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1885b-5e25-4066-9f50-24f37f2682c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.111605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dd0c0c8b-0200-40bc-9d66-5c092847a91b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:20.112889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dd0c0c8b-0200-40bc-9d66-5c092847a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:20.123758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1885b-5e25-4066-9f50-24f37f2682c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-66d1885b-5e25-4066-9f50-24f37f2682c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:20.133702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:20.134665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:20.135449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 92/186] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:49:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:20.136148 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1885b-5e25-4066-9f50-24f37f2682c8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:20.203664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 95/187] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:20.204870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175fc94-3d59-4826-81bb-6771f717a823 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.205161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175fc94-3d59-4826-81bb-6771f717a823 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.205436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3175fc94-3d59-4826-81bb-6771f717a823 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.210888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 96/188] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:20.210888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175fc94-3d59-4826-81bb-6771f717a823 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:20.238994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:20.277479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1885b-5e25-4066-9f50-24f37f2682c8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:20.320040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd50c9d-20b3-4e14-a81f-6e7b980304d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:20.320753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd50c9d-20b3-4e14-a81f-6e7b980304d2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.321033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd50c9d-20b3-4e14-a81f-6e7b980304d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.321808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd50c9d-20b3-4e14-a81f-6e7b980304d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.322494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd50c9d-20b3-4e14-a81f-6e7b980304d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:20.323982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd50c9d-20b3-4e14-a81f-6e7b980304d2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:20.326356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 93/189] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:20.327696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ed3a-babc-4f5c-9329-e3c3cca76eb9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.327696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ed3a-babc-4f5c-9329-e3c3cca76eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.327908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938ed3a-babc-4f5c-9329-e3c3cca76eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.344874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3175fc94-3d59-4826-81bb-6771f717a823 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:20.346638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8938ed3a-babc-4f5c-9329-e3c3cca76eb9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:20.347990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8938ed3a-babc-4f5c-9329-e3c3cca76eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:20.352275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:20.379198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aec83d-d376-42a4-980c-447728aaae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:20.379949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aec83d-d376-42a4-980c-447728aaae02 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.380247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aec83d-d376-42a4-980c-447728aaae02 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.380609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aec83d-d376-42a4-980c-447728aaae02 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.381366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aec83d-d376-42a4-980c-447728aaae02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:20.381671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aec83d-d376-42a4-980c-447728aaae02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:20.383070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aec83d-d376-42a4-980c-447728aaae02 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:20.392446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 97/190] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:20.393489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aec83d-d376-42a4-980c-447728aaae02 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:20.431530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 94/191] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:20.432397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938ed3a-babc-4f5c-9329-e3c3cca76eb9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:20.502383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aec83d-d376-42a4-980c-447728aaae02 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:20.506013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:20.537506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003c36a-e5aa-4a19-97db-44d0aea39033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:20.538304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003c36a-e5aa-4a19-97db-44d0aea39033 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.538588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003c36a-e5aa-4a19-97db-44d0aea39033 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.538863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1003c36a-e5aa-4a19-97db-44d0aea39033 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.541237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938ed3a-babc-4f5c-9329-e3c3cca76eb9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:20.549279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1003c36a-e5aa-4a19-97db-44d0aea39033 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1003c36a-e5aa-4a19-97db-44d0aea39033 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:20.557351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:20.558303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:20.559114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 98/192] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:20.559795 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003c36a-e5aa-4a19-97db-44d0aea39033 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:20.580956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684e81-63b6-486c-852d-519d959b643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:20.581565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684e81-63b6-486c-852d-519d959b643f None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.581826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684e81-63b6-486c-852d-519d959b643f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.582100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0684e81-63b6-486c-852d-519d959b643f None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.582810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0684e81-63b6-486c-852d-519d959b643f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:20.584275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0684e81-63b6-486c-852d-519d959b643f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:20.588979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:20.660712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1003c36a-e5aa-4a19-97db-44d0aea39033 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:20.669321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 95/193] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:20 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:20.670359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684e81-63b6-486c-852d-519d959b643f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:20.710051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae826513-f886-4522-892c-9eb962e39649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:20.711022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae826513-f886-4522-892c-9eb962e39649 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.711373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae826513-f886-4522-892c-9eb962e39649 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.711713 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae826513-f886-4522-892c-9eb962e39649 None admin] PATH_INFO: `/v3/users/47020c050032499bb962768e37e6018d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.727822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae826513-f886-4522-892c-9eb962e39649 None admin] RBAC: Authorizing `identity:get_user(user_id=47020c050032499bb962768e37e6018d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:20.729508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae826513-f886-4522-892c-9eb962e39649 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:20.731364 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 99/194] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:20 2022] GET /identity/v3/users/47020c050032499bb962768e37e6018d => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:20.736128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae826513-f886-4522-892c-9eb962e39649 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:20.806526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0684e81-63b6-486c-852d-519d959b643f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:20.828952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:20.837296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:20.848658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae826513-f886-4522-892c-9eb962e39649 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:20.852334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b216cf6-a031-4ec8-ae05-82ba0511208c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:20.853145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216cf6-a031-4ec8-ae05-82ba0511208c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.853427 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216cf6-a031-4ec8-ae05-82ba0511208c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.854129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b216cf6-a031-4ec8-ae05-82ba0511208c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.867493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b216cf6-a031-4ec8-ae05-82ba0511208c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-6b216cf6-a031-4ec8-ae05-82ba0511208c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:20.877566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:20.878459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:20.879331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 96/195] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:20.888973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b216cf6-a031-4ec8-ae05-82ba0511208c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:20.889767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec84e51-0c42-4b84-9827-f811f806b0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:20.890711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec84e51-0c42-4b84-9827-f811f806b0ac None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:20.891000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec84e51-0c42-4b84-9827-f811f806b0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:20.891275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec84e51-0c42-4b84-9827-f811f806b0ac None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:20.892085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec84e51-0c42-4b84-9827-f811f806b0ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:20.892395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec84e51-0c42-4b84-9827-f811f806b0ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:20.893819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec84e51-0c42-4b84-9827-f811f806b0ac None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:20.903157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 100/196] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:20.904439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec84e51-0c42-4b84-9827-f811f806b0ac None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:21.011540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b216cf6-a031-4ec8-ae05-82ba0511208c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:21.048280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec84e51-0c42-4b84-9827-f811f806b0ac None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:21.051994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0698c-8c93-4a70-829f-1ebac96a49f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:21.052650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0698c-8c93-4a70-829f-1ebac96a49f2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:21.052935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0698c-8c93-4a70-829f-1ebac96a49f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:21.053212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0698c-8c93-4a70-829f-1ebac96a49f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:21.084940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210449ce-55f3-4b16-940d-5aaa14419beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:21.085669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210449ce-55f3-4b16-940d-5aaa14419beb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:21.085951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210449ce-55f3-4b16-940d-5aaa14419beb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:21.086278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210449ce-55f3-4b16-940d-5aaa14419beb None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:21.087034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210449ce-55f3-4b16-940d-5aaa14419beb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:21.087392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210449ce-55f3-4b16-940d-5aaa14419beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:21.088801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210449ce-55f3-4b16-940d-5aaa14419beb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:21.097957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 101/197] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:21.098562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210449ce-55f3-4b16-940d-5aaa14419beb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:21.112030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:21.112685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:21.132324 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0698c-8c93-4a70-829f-1ebac96a49f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:21.133838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0698c-8c93-4a70-829f-1ebac96a49f2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:21.206776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210449ce-55f3-4b16-940d-5aaa14419beb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:21.239029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 97/198] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:21.239894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0698c-8c93-4a70-829f-1ebac96a49f2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:21.247184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c8dd8-d344-44c9-8e03-ae6d2670d133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:21.248675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c8dd8-d344-44c9-8e03-ae6d2670d133 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:21.249053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c8dd8-d344-44c9-8e03-ae6d2670d133 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:21.249332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c8dd8-d344-44c9-8e03-ae6d2670d133 None admin] PATH_INFO: `/v3/users/47020c050032499bb962768e37e6018d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:21.250560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c8dd8-d344-44c9-8e03-ae6d2670d133 None admin] RBAC: Authorizing `identity:get_user(user_id=47020c050032499bb962768e37e6018d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:21.252121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c8dd8-d344-44c9-8e03-ae6d2670d133 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:21.254013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 102/199] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:21 2022] GET /identity/v3/users/47020c050032499bb962768e37e6018d => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:21.254579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c8dd8-d344-44c9-8e03-ae6d2670d133 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:21.338901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:21.344141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:21.360473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0698c-8c93-4a70-829f-1ebac96a49f2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:21.371517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c8dd8-d344-44c9-8e03-ae6d2670d133 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:21.401485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218e965-04e1-4c0e-a719-844f7a74b3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:21.403075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218e965-04e1-4c0e-a719-844f7a74b3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:21.404392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218e965-04e1-4c0e-a719-844f7a74b3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:21.404852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218e965-04e1-4c0e-a719-844f7a74b3e9 None admin] PATH_INFO: `/v3/users/f42b447d38c141b99e5aedea1f1b1e23` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:21.406740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218e965-04e1-4c0e-a719-844f7a74b3e9 None admin] RBAC: Authorizing `identity:get_user(user_id=f42b447d38c141b99e5aedea1f1b1e23)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:21.408756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218e965-04e1-4c0e-a719-844f7a74b3e9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:21.410947 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 98/200] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:21 2022] GET /identity/v3/users/f42b447d38c141b99e5aedea1f1b1e23 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:21.411424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa5bd-0360-4567-a49f-dc0dfa604171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:21.412245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218e965-04e1-4c0e-a719-844f7a74b3e9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:21.412637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa5bd-0360-4567-a49f-dc0dfa604171 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:21.413114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa5bd-0360-4567-a49f-dc0dfa604171 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:21.413480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfa5bd-0360-4567-a49f-dc0dfa604171 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:21.414840 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfa5bd-0360-4567-a49f-dc0dfa604171 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:21.417305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfa5bd-0360-4567-a49f-dc0dfa604171 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:21.418752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 103/201] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:21 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:21.424801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa5bd-0360-4567-a49f-dc0dfa604171 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:21.537780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfa5bd-0360-4567-a49f-dc0dfa604171 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:21.543521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218e965-04e1-4c0e-a719-844f7a74b3e9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:21.579525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7781a9-1796-40a3-850c-12d189e9b70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:21.580683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7781a9-1796-40a3-850c-12d189e9b70f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:21.581518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7781a9-1796-40a3-850c-12d189e9b70f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:21.582313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7781a9-1796-40a3-850c-12d189e9b70f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:21.586215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923d9b7-4056-40f9-8390-9fa27d270501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:21.587317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d9b7-4056-40f9-8390-9fa27d270501 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:21.587442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d9b7-4056-40f9-8390-9fa27d270501 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:21.587795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5923d9b7-4056-40f9-8390-9fa27d270501 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:21.602714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:21.610417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:21.665316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923d9b7-4056-40f9-8390-9fa27d270501 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:21.667189 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5923d9b7-4056-40f9-8390-9fa27d270501 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:21.677735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7781a9-1796-40a3-850c-12d189e9b70f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:21.680339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7781a9-1796-40a3-850c-12d189e9b70f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:21.794118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 99/202] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:21.796150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923d9b7-4056-40f9-8390-9fa27d270501 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:21.802955 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 104/203] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:21.804429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7781a9-1796-40a3-850c-12d189e9b70f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:21.849580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:21.860595 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:21.902964 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5923d9b7-4056-40f9-8390-9fa27d270501 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:21.922150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7781a9-1796-40a3-850c-12d189e9b70f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:21.939806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b89173-12c8-48f5-b04d-6f8ef64124f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:21.940645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89173-12c8-48f5-b04d-6f8ef64124f4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:21.941017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89173-12c8-48f5-b04d-6f8ef64124f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:21.941389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b89173-12c8-48f5-b04d-6f8ef64124f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:21.942323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b89173-12c8-48f5-b04d-6f8ef64124f4 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=18d10b4af4be46f482585d23de6e290d, user.id=47020c050032499bb962768e37e6018d) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:21.942724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b89173-12c8-48f5-b04d-6f8ef64124f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:21.944382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b89173-12c8-48f5-b04d-6f8ef64124f4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:21.956216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 100/204] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:21 2022] GET /identity/v3/role_assignments?user.id=47020c050032499bb962768e37e6018d&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:21.957419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b89173-12c8-48f5-b04d-6f8ef64124f4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:21.973759 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3174275-7602-4397-80ef-411cf34563da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:21.974986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3174275-7602-4397-80ef-411cf34563da None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:21.975471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3174275-7602-4397-80ef-411cf34563da None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:21.975901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3174275-7602-4397-80ef-411cf34563da None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:21.977699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3174275-7602-4397-80ef-411cf34563da None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:21.979647 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3174275-7602-4397-80ef-411cf34563da None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:21.991609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 105/205] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:21 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:21.995056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3174275-7602-4397-80ef-411cf34563da None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:22.194901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3174275-7602-4397-80ef-411cf34563da None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:22.199698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b89173-12c8-48f5-b04d-6f8ef64124f4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:22.211212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:22.233631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:22.236246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ba7ac-4824-4151-8019-f9d6b179ee41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:22.237247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ba7ac-4824-4151-8019-f9d6b179ee41 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:22.238940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ba7ac-4824-4151-8019-f9d6b179ee41 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:22.240129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774ba7ac-4824-4151-8019-f9d6b179ee41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:22.241114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ba7ac-4824-4151-8019-f9d6b179ee41 None admin] RBAC: Adding query filter params (role.id=5b16ed690a6942c288df268569b6ab85, scope.project.id=18d10b4af4be46f482585d23de6e290d, user.id=47020c050032499bb962768e37e6018d) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:22.243476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ba7ac-4824-4151-8019-f9d6b179ee41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:22.245124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774ba7ac-4824-4151-8019-f9d6b179ee41 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:22.252899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 106/206] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:21 2022] GET /identity/v3/role_assignments?user.id=47020c050032499bb962768e37e6018d&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=5b16ed690a6942c288df268569b6ab85 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:22.280850 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15403058-5c1a-4656-a16c-3b408e9ef62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:22.281753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15403058-5c1a-4656-a16c-3b408e9ef62f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:22.282031 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15403058-5c1a-4656-a16c-3b408e9ef62f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:22.282299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15403058-5c1a-4656-a16c-3b408e9ef62f None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:22.283713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15403058-5c1a-4656-a16c-3b408e9ef62f None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:22.285750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15403058-5c1a-4656-a16c-3b408e9ef62f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:22.292130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 101/207] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:21 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:22.293843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ba7ac-4824-4151-8019-f9d6b179ee41 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:22.468935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774ba7ac-4824-4151-8019-f9d6b179ee41 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:22.505227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd3ea3-49ec-4071-8d5d-5b9f19b01a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:22.505887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd3ea3-49ec-4071-8d5d-5b9f19b01a46 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:22.506173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd3ea3-49ec-4071-8d5d-5b9f19b01a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:22.506452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd3ea3-49ec-4071-8d5d-5b9f19b01a46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:22.507293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd3ea3-49ec-4071-8d5d-5b9f19b01a46 None admin] RBAC: Adding query filter params (role.id=a0dae20055d1456ba8d94cfec7d62668, scope.project.id=37a366467c364c32b052631d9f1b6e63, user.id=f42b447d38c141b99e5aedea1f1b1e23) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:22.507608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd3ea3-49ec-4071-8d5d-5b9f19b01a46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:22.509105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd3ea3-49ec-4071-8d5d-5b9f19b01a46 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:22.516207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 107/208] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:22 2022] GET /identity/v3/role_assignments?user.id=f42b447d38c141b99e5aedea1f1b1e23&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=a0dae20055d1456ba8d94cfec7d62668 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:23.080736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f5f14-d58b-4019-b29a-6a680c426899 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:23.081099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f5f14-d58b-4019-b29a-6a680c426899 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:23.081276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f5f14-d58b-4019-b29a-6a680c426899 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:23.082658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 102/209] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:23.088294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6579-8907-4ed7-a383-cd566ee9c633 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:23.088582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6579-8907-4ed7-a383-cd566ee9c633 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:23.088858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd6579-8907-4ed7-a383-cd566ee9c633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:23.110736 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-98fd6579-8907-4ed7-a383-cd566ee9c633 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:23.111943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-98fd6579-8907-4ed7-a383-cd566ee9c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:23.141228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae3a6b-faed-4d65-a8dd-fe587838938a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:23.141517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae3a6b-faed-4d65-a8dd-fe587838938a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:23.141790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae3a6b-faed-4d65-a8dd-fe587838938a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:23.143279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 103/210] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:23.150269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed82c5-009c-44b0-a08b-ad136a58c040 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:23.150567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed82c5-009c-44b0-a08b-ad136a58c040 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:23.150834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed82c5-009c-44b0-a08b-ad136a58c040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:23.161844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:23.173389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c3ed82c5-009c-44b0-a08b-ad136a58c040 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:23.175261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c3ed82c5-009c-44b0-a08b-ad136a58c040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:23.204012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 108/211] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:23.224583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd6579-8907-4ed7-a383-cd566ee9c633 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:23.266017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 104/212] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:23.290851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed82c5-009c-44b0-a08b-ad136a58c040 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:23.330391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd6579-8907-4ed7-a383-cd566ee9c633 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:23.373516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eabe5-5c9c-4f5c-8ad5-750fdde58c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:23.374464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eabe5-5c9c-4f5c-8ad5-750fdde58c45 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:23.374747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eabe5-5c9c-4f5c-8ad5-750fdde58c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:23.375328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78eabe5-5c9c-4f5c-8ad5-750fdde58c45 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:23.388572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78eabe5-5c9c-4f5c-8ad5-750fdde58c45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d78eabe5-5c9c-4f5c-8ad5-750fdde58c45 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:23.398008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:23.398913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:23.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 109/213] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:23.408045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eabe5-5c9c-4f5c-8ad5-750fdde58c45 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:23.423966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed82c5-009c-44b0-a08b-ad136a58c040 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:23.442293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:23.443705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:23.475423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d552-a124-413d-9012-bba1e40d08fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:23.476654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d552-a124-413d-9012-bba1e40d08fa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:23.476958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d552-a124-413d-9012-bba1e40d08fa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:23.477248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2219d552-a124-413d-9012-bba1e40d08fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:23.478891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219d552-a124-413d-9012-bba1e40d08fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:23.481074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2219d552-a124-413d-9012-bba1e40d08fa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:23.484009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 105/214] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:23.488586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d552-a124-413d-9012-bba1e40d08fa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:23.539872 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78eabe5-5c9c-4f5c-8ad5-750fdde58c45 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:23.584282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e41987-76c6-4ae0-8364-3e4d770a4315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:23.585395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e41987-76c6-4ae0-8364-3e4d770a4315 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:23.585878 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e41987-76c6-4ae0-8364-3e4d770a4315 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:23.586377 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e41987-76c6-4ae0-8364-3e4d770a4315 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:23.587430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e41987-76c6-4ae0-8364-3e4d770a4315 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:23.587963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e41987-76c6-4ae0-8364-3e4d770a4315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:23.589590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e41987-76c6-4ae0-8364-3e4d770a4315 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:23.600605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 110/215] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:23.600764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2219d552-a124-413d-9012-bba1e40d08fa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:23.607994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e41987-76c6-4ae0-8364-3e4d770a4315 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:23.641155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac096-1e9d-45c0-bf2d-5b5ba5e3fddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:23.641805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac096-1e9d-45c0-bf2d-5b5ba5e3fddc None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:23.642085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac096-1e9d-45c0-bf2d-5b5ba5e3fddc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:23.642409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ac096-1e9d-45c0-bf2d-5b5ba5e3fddc None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:23.643262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ac096-1e9d-45c0-bf2d-5b5ba5e3fddc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:23.645007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ac096-1e9d-45c0-bf2d-5b5ba5e3fddc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:23.720071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:23.727116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e41987-76c6-4ae0-8364-3e4d770a4315 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:23.744192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 106/216] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:23 2022] POST /identity/v3/users => generated 297 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 21:49:23.769568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28381e25-4383-4f6c-a63d-4cda7931eb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:23.770661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381e25-4383-4f6c-a63d-4cda7931eb21 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:23.770943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381e25-4383-4f6c-a63d-4cda7931eb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:23.771218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28381e25-4383-4f6c-a63d-4cda7931eb21 None admin] PATH_INFO: `/v3/users/8d2bc038d5134d8d92e90f5e55081340` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:23.789129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28381e25-4383-4f6c-a63d-4cda7931eb21 None admin] RBAC: Authorizing `identity:get_user(user_id=8d2bc038d5134d8d92e90f5e55081340)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:23.790725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28381e25-4383-4f6c-a63d-4cda7931eb21 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:23.796100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 111/217] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:23 2022] GET /identity/v3/users/8d2bc038d5134d8d92e90f5e55081340 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:23.799749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac096-1e9d-45c0-bf2d-5b5ba5e3fddc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:23.842657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:23.925987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ac096-1e9d-45c0-bf2d-5b5ba5e3fddc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:23.962208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476d622-99be-4b52-ba8d-842458b5abba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:23.962868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476d622-99be-4b52-ba8d-842458b5abba None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:23.963150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476d622-99be-4b52-ba8d-842458b5abba None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:23.963428 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476d622-99be-4b52-ba8d-842458b5abba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:24.043182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476d622-99be-4b52-ba8d-842458b5abba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:24.044704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476d622-99be-4b52-ba8d-842458b5abba None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:24.082244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:24.164262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da223-b703-4db8-bfe0-daba4a339513 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:24.164607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da223-b703-4db8-bfe0-daba4a339513 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:24.164817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518da223-b703-4db8-bfe0-daba4a339513 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:24.166362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 112/218] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:24.167502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 107/219] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:24.172330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044189de-00ff-46a5-82cf-b0e9bdd3724b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:24.173102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044189de-00ff-46a5-82cf-b0e9bdd3724b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:24.173600 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044189de-00ff-46a5-82cf-b0e9bdd3724b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:24.173705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476d622-99be-4b52-ba8d-842458b5abba None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:24.192018 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-044189de-00ff-46a5-82cf-b0e9bdd3724b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:24.193606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-044189de-00ff-46a5-82cf-b0e9bdd3724b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:24.275667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 113/220] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:24.304277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044189de-00ff-46a5-82cf-b0e9bdd3724b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:24.353643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476d622-99be-4b52-ba8d-842458b5abba None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:24.401696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39aa4-3e8a-4dd5-8b52-1659a4b16361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:24.402579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39aa4-3e8a-4dd5-8b52-1659a4b16361 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:24.402881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39aa4-3e8a-4dd5-8b52-1659a4b16361 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:24.403142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f39aa4-3e8a-4dd5-8b52-1659a4b16361 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:24.408669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f39aa4-3e8a-4dd5-8b52-1659a4b16361 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:24.410146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f39aa4-3e8a-4dd5-8b52-1659a4b16361 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:24.412137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 108/221] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:24 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:24.418961 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39aa4-3e8a-4dd5-8b52-1659a4b16361 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:24.427322 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:24.447056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044189de-00ff-46a5-82cf-b0e9bdd3724b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:24.472415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:24.488588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8661f2-f2f9-4eaf-bfe2-7256776a0f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:24.489862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8661f2-f2f9-4eaf-bfe2-7256776a0f12 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:24.490367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8661f2-f2f9-4eaf-bfe2-7256776a0f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:24.490897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8661f2-f2f9-4eaf-bfe2-7256776a0f12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:24.504397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8661f2-f2f9-4eaf-bfe2-7256776a0f12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0b8661f2-f2f9-4eaf-bfe2-7256776a0f12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:24.513385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:24.514319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:24.515111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:24.518399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 114/222] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:24.524273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8661f2-f2f9-4eaf-bfe2-7256776a0f12 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:24.671846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f39aa4-3e8a-4dd5-8b52-1659a4b16361 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:24.692442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8661f2-f2f9-4eaf-bfe2-7256776a0f12 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:24.729026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388904d7-e4c2-4527-bc5c-517f77e5b852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:24.729800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388904d7-e4c2-4527-bc5c-517f77e5b852 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:24.730082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388904d7-e4c2-4527-bc5c-517f77e5b852 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:24.730469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388904d7-e4c2-4527-bc5c-517f77e5b852 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:24.731218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388904d7-e4c2-4527-bc5c-517f77e5b852 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:24.731521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388904d7-e4c2-4527-bc5c-517f77e5b852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:24.733469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388904d7-e4c2-4527-bc5c-517f77e5b852 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:24.738924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49a61b-b2a0-438a-92b5-d917e81aa38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:24.739770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49a61b-b2a0-438a-92b5-d917e81aa38d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:24.740231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49a61b-b2a0-438a-92b5-d917e81aa38d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:24.740645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49a61b-b2a0-438a-92b5-d917e81aa38d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:24.741648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49a61b-b2a0-438a-92b5-d917e81aa38d None admin] RBAC: Adding query filter params (role.id=36dde009f57f45dd9ded880f26a9b2cc, scope.project.id=18d10b4af4be46f482585d23de6e290d, user.id=8d2bc038d5134d8d92e90f5e55081340) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:24.742110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49a61b-b2a0-438a-92b5-d917e81aa38d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:24.742454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 115/223] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:24.743799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bda67e-093f-493c-9939-8b8da3dbc209 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:24.744107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bda67e-093f-493c-9939-8b8da3dbc209 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:24.744382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bda67e-093f-493c-9939-8b8da3dbc209 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:24.744579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c49a61b-b2a0-438a-92b5-d917e81aa38d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:24.745603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 116/224] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:24.750564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bda67e-093f-493c-9939-8b8da3dbc209 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:24.751765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 109/225] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:24 2022] GET /identity/v3/role_assignments?user.id=8d2bc038d5134d8d92e90f5e55081340&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:24.753261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa502d3a-9439-4878-9b00-4a10cdd9d5e7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:24.753752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa502d3a-9439-4878-9b00-4a10cdd9d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:24.754227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa502d3a-9439-4878-9b00-4a10cdd9d5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:24.769466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:24.773743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-aa502d3a-9439-4878-9b00-4a10cdd9d5e7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:24.775215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aa502d3a-9439-4878-9b00-4a10cdd9d5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:24.925334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bda67e-093f-493c-9939-8b8da3dbc209 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:24.931406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:24.943382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 110/226] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:24.966844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa502d3a-9439-4878-9b00-4a10cdd9d5e7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:24.967658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991214b6-1ac0-4dd9-96ac-5559fae30bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:24.968572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991214b6-1ac0-4dd9-96ac-5559fae30bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:24.968850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991214b6-1ac0-4dd9-96ac-5559fae30bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:24.969121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991214b6-1ac0-4dd9-96ac-5559fae30bd1 None admin] PATH_INFO: `/v3/users/47020c050032499bb962768e37e6018d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:24.970392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991214b6-1ac0-4dd9-96ac-5559fae30bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=47020c050032499bb962768e37e6018d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:24.971894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991214b6-1ac0-4dd9-96ac-5559fae30bd1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:24.973973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 117/227] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:24 2022] GET /identity/v3/users/47020c050032499bb962768e37e6018d => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:24.989642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991214b6-1ac0-4dd9-96ac-5559fae30bd1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:25.072668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:25.120250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991214b6-1ac0-4dd9-96ac-5559fae30bd1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:25.121443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa502d3a-9439-4878-9b00-4a10cdd9d5e7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:25.161293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9452d-9a6a-4a6e-97cc-6dbabf17d690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:25.162223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9452d-9a6a-4a6e-97cc-6dbabf17d690 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:25.162554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9452d-9a6a-4a6e-97cc-6dbabf17d690 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:25.162835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9452d-9a6a-4a6e-97cc-6dbabf17d690 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:25.164069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9452d-9a6a-4a6e-97cc-6dbabf17d690 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:25.168718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9452d-9a6a-4a6e-97cc-6dbabf17d690 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:25.172739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 118/228] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:24 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:25.177139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9452d-9a6a-4a6e-97cc-6dbabf17d690 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:25.208720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cd4b9-4305-45e4-89bd-2a0e11ed0651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:25.209562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd4b9-4305-45e4-89bd-2a0e11ed0651 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:25.209850 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd4b9-4305-45e4-89bd-2a0e11ed0651 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:25.210143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04cd4b9-4305-45e4-89bd-2a0e11ed0651 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:25.229482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04cd4b9-4305-45e4-89bd-2a0e11ed0651 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f04cd4b9-4305-45e4-89bd-2a0e11ed0651 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:25.238220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:25.239154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:25.239966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 111/229] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:25.250273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cd4b9-4305-45e4-89bd-2a0e11ed0651 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:25.317043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9452d-9a6a-4a6e-97cc-6dbabf17d690 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:25.356448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af042eed-32e2-445e-9939-8c32e5f5f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:25.358247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af042eed-32e2-445e-9939-8c32e5f5f8b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:25.358768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af042eed-32e2-445e-9939-8c32e5f5f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:25.359249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af042eed-32e2-445e-9939-8c32e5f5f8b8 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d/users/47020c050032499bb962768e37e6018d/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:25.361502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af042eed-32e2-445e-9939-8c32e5f5f8b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=18d10b4af4be46f482585d23de6e290d, user_id=47020c050032499bb962768e37e6018d, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:25.363402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af042eed-32e2-445e-9939-8c32e5f5f8b8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:25.377959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:25.432607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 119/230] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:49:25 2022] PUT /identity/v3/projects/18d10b4af4be46f482585d23de6e290d/users/47020c050032499bb962768e37e6018d/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:25.433148 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:25.436417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04cd4b9-4305-45e4-89bd-2a0e11ed0651 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:25.492114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515790b-88eb-44ab-8969-8abf3f4a6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:25.493119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515790b-88eb-44ab-8969-8abf3f4a6f43 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:25.493546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515790b-88eb-44ab-8969-8abf3f4a6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:25.493967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1515790b-88eb-44ab-8969-8abf3f4a6f43 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:25.494898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515790b-88eb-44ab-8969-8abf3f4a6f43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:25.495356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515790b-88eb-44ab-8969-8abf3f4a6f43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:25.497112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1515790b-88eb-44ab-8969-8abf3f4a6f43 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:25.516496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 112/231] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:25.521865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af042eed-32e2-445e-9939-8c32e5f5f8b8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:25.648865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af042eed-32e2-445e-9939-8c32e5f5f8b8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:25.685634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175465a4-58c4-4325-8356-bb5e19c6f37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:25.686811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175465a4-58c4-4325-8356-bb5e19c6f37e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:25.687252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175465a4-58c4-4325-8356-bb5e19c6f37e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:25.687671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175465a4-58c4-4325-8356-bb5e19c6f37e None admin] PATH_INFO: `/v3/users/47020c050032499bb962768e37e6018d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:25.689098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175465a4-58c4-4325-8356-bb5e19c6f37e None admin] RBAC: Authorizing `identity:get_user(user_id=47020c050032499bb962768e37e6018d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:25.690723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175465a4-58c4-4325-8356-bb5e19c6f37e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:25.694549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 120/232] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:25 2022] GET /identity/v3/users/47020c050032499bb962768e37e6018d => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:25.698026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515790b-88eb-44ab-8969-8abf3f4a6f43 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:25.830267 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1515790b-88eb-44ab-8969-8abf3f4a6f43 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:25.851185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:25.875429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38c8cfe-6008-4019-aaad-2321bcd32f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:25.876330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c8cfe-6008-4019-aaad-2321bcd32f6e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:25.876624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c8cfe-6008-4019-aaad-2321bcd32f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:25.876883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38c8cfe-6008-4019-aaad-2321bcd32f6e None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:25.878179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c8cfe-6008-4019-aaad-2321bcd32f6e None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:25.879628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38c8cfe-6008-4019-aaad-2321bcd32f6e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:25.881571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 113/233] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:25 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:25.893091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175465a4-58c4-4325-8356-bb5e19c6f37e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:25.984654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:26.023792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175465a4-58c4-4325-8356-bb5e19c6f37e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:26.073752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00955585-1cab-4ed7-b8ae-91f4943ce19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:26.074650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00955585-1cab-4ed7-b8ae-91f4943ce19d None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:26.074933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00955585-1cab-4ed7-b8ae-91f4943ce19d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:26.075206 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00955585-1cab-4ed7-b8ae-91f4943ce19d None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d/users/47020c050032499bb962768e37e6018d/roles/5b16ed690a6942c288df268569b6ab85` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:26.078130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00955585-1cab-4ed7-b8ae-91f4943ce19d None admin] RBAC: Authorizing `identity:create_grant(project_id=18d10b4af4be46f482585d23de6e290d, user_id=47020c050032499bb962768e37e6018d, role_id=5b16ed690a6942c288df268569b6ab85)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:26.079589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00955585-1cab-4ed7-b8ae-91f4943ce19d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:26.182116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 121/234] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:49:25 2022] PUT /identity/v3/projects/18d10b4af4be46f482585d23de6e290d/users/47020c050032499bb962768e37e6018d/roles/5b16ed690a6942c288df268569b6ab85 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:26.304069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acc242-7add-4b0c-ae97-936d4e6f53ad None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:26.304400 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acc242-7add-4b0c-ae97-936d4e6f53ad None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:26.304624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6acc242-7add-4b0c-ae97-936d4e6f53ad None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:26.306002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 114/235] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:26.312725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d85ab-47e9-4f30-b457-ea8b94508d17 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:26.313023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d85ab-47e9-4f30-b457-ea8b94508d17 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:26.313287 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66d85ab-47e9-4f30-b457-ea8b94508d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:26.323137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e353544-0af6-45c4-9a56-10fc99cadf71 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:26.323460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e353544-0af6-45c4-9a56-10fc99cadf71 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:26.323686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e353544-0af6-45c4-9a56-10fc99cadf71 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:26.325204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 115/236] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:26.337568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ed063-bccf-424f-bd89-dbadc2dbdd52 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:26.337870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ed063-bccf-424f-bd89-dbadc2dbdd52 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:26.338115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3ed063-bccf-424f-bd89-dbadc2dbdd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:26.339318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c66d85ab-47e9-4f30-b457-ea8b94508d17 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:26.340692 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c66d85ab-47e9-4f30-b457-ea8b94508d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:26.365077 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bd3ed063-bccf-424f-bd89-dbadc2dbdd52 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:26.366291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bd3ed063-bccf-424f-bd89-dbadc2dbdd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:26.418685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 122/237] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 21:49:26.452994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 116/238] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:26.458147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d85ab-47e9-4f30-b457-ea8b94508d17 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:26.480603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ed063-bccf-424f-bd89-dbadc2dbdd52 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:26.538023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:26.586401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66d85ab-47e9-4f30-b457-ea8b94508d17 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:26.586885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3ed063-bccf-424f-bd89-dbadc2dbdd52 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:26.606461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:26.626107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b192-134f-4a68-add9-2f556bc7b2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:26.626909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b192-134f-4a68-add9-2f556bc7b2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:26.627192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b192-134f-4a68-add9-2f556bc7b2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:26.627469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e1b192-134f-4a68-add9-2f556bc7b2a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:26.630506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ff44-ec9d-4ee5-a581-45d3769ee47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:26.631301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ff44-ec9d-4ee5-a581-45d3769ee47c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:26.631577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ff44-ec9d-4ee5-a581-45d3769ee47c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:26.631853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10ff44-ec9d-4ee5-a581-45d3769ee47c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:26.633751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ff44-ec9d-4ee5-a581-45d3769ee47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:26.635202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa10ff44-ec9d-4ee5-a581-45d3769ee47c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:26.636857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 123/239] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:26.644397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ff44-ec9d-4ee5-a581-45d3769ee47c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:26.650511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e1b192-134f-4a68-add9-2f556bc7b2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e9e1b192-134f-4a68-add9-2f556bc7b2a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:26.659321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:26.660465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:26.661268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 117/240] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:26.666841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b192-134f-4a68-add9-2f556bc7b2a8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:26.756947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10ff44-ec9d-4ee5-a581-45d3769ee47c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:26.777678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e1b192-134f-4a68-add9-2f556bc7b2a8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:26.786021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:26.795767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bcb62-ee43-48f2-82de-52a0d6635634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:26.796828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bcb62-ee43-48f2-82de-52a0d6635634 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:26.797333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bcb62-ee43-48f2-82de-52a0d6635634 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:26.797846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9bcb62-ee43-48f2-82de-52a0d6635634 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:26.798765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bcb62-ee43-48f2-82de-52a0d6635634 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:26.800542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9bcb62-ee43-48f2-82de-52a0d6635634 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:26.815026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd2bc-44db-4eab-a442-30cee7e35e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:26.815717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd2bc-44db-4eab-a442-30cee7e35e0f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:26.822676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd2bc-44db-4eab-a442-30cee7e35e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:26.822676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968cd2bc-44db-4eab-a442-30cee7e35e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:26.822676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd2bc-44db-4eab-a442-30cee7e35e0f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:26.822676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd2bc-44db-4eab-a442-30cee7e35e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:26.822676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968cd2bc-44db-4eab-a442-30cee7e35e0f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:26.832021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 118/241] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:26.833406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd2bc-44db-4eab-a442-30cee7e35e0f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:26.876271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:26.937100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968cd2bc-44db-4eab-a442-30cee7e35e0f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:26.948760 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 124/242] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:26 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:27.013458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6df81-4eaf-4ecd-96e4-0a5fb4627217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:27.014388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6df81-4eaf-4ecd-96e4-0a5fb4627217 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:27.014671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6df81-4eaf-4ecd-96e4-0a5fb4627217 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:27.014945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6df81-4eaf-4ecd-96e4-0a5fb4627217 None admin] PATH_INFO: `/v3/users/dfc5ebbe127b443c970bc0569b9a376a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:27.043753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6df81-4eaf-4ecd-96e4-0a5fb4627217 None admin] RBAC: Authorizing `identity:get_user(user_id=dfc5ebbe127b443c970bc0569b9a376a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:27.046091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6df81-4eaf-4ecd-96e4-0a5fb4627217 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:27.048356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 119/243] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:26 2022] GET /identity/v3/users/dfc5ebbe127b443c970bc0569b9a376a => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:27.054701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bcb62-ee43-48f2-82de-52a0d6635634 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:27.199571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9bcb62-ee43-48f2-82de-52a0d6635634 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:27.237844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd5cd0-0b10-45a0-8fb2-15f5b033ef25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:27.238506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd5cd0-0b10-45a0-8fb2-15f5b033ef25 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:27.238788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd5cd0-0b10-45a0-8fb2-15f5b033ef25 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:27.239083 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd5cd0-0b10-45a0-8fb2-15f5b033ef25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:27.291941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:27.312659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd5cd0-0b10-45a0-8fb2-15f5b033ef25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:27.314198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd5cd0-0b10-45a0-8fb2-15f5b033ef25 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:27.425651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 125/244] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:27.431638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6df81-4eaf-4ecd-96e4-0a5fb4627217 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:27.549346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:27.553079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6df81-4eaf-4ecd-96e4-0a5fb4627217 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:27.594726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ed0da-775b-4654-9766-38d56100be94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:27.595600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ed0da-775b-4654-9766-38d56100be94 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:27.595877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ed0da-775b-4654-9766-38d56100be94 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:27.596177 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ed0da-775b-4654-9766-38d56100be94 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:27.597439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ed0da-775b-4654-9766-38d56100be94 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:27.598900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ed0da-775b-4654-9766-38d56100be94 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:27.600999 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 120/245] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:27 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:27.607445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd5cd0-0b10-45a0-8fb2-15f5b033ef25 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:27.640030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783dda7-aace-460a-b613-d06bf2f230b3 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:27.640570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783dda7-aace-460a-b613-d06bf2f230b3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:27.640836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783dda7-aace-460a-b613-d06bf2f230b3 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:27.642213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 121/246] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:27.647616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5021b93-afd5-4391-9c1e-06eb12c16e69 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:27.647901 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5021b93-afd5-4391-9c1e-06eb12c16e69 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:27.648196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5021b93-afd5-4391-9c1e-06eb12c16e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:27.666008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c5021b93-afd5-4391-9c1e-06eb12c16e69 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:27.667043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c5021b93-afd5-4391-9c1e-06eb12c16e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:27.739572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:27.752257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 122/247] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:27.759839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd5cd0-0b10-45a0-8fb2-15f5b033ef25 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:27.777555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5021b93-afd5-4391-9c1e-06eb12c16e69 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:27.803861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc1f13-69c4-493e-bf49-03c7d092a3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:27.804587 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1f13-69c4-493e-bf49-03c7d092a3c8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:27.804876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1f13-69c4-493e-bf49-03c7d092a3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:27.805160 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc1f13-69c4-493e-bf49-03c7d092a3c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:27.806038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc1f13-69c4-493e-bf49-03c7d092a3c8 None admin] RBAC: Adding query filter params (role.id=a0dae20055d1456ba8d94cfec7d62668, scope.project.id=18d10b4af4be46f482585d23de6e290d, user.id=dfc5ebbe127b443c970bc0569b9a376a) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:27.806357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc1f13-69c4-493e-bf49-03c7d092a3c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:27.807945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc1f13-69c4-493e-bf49-03c7d092a3c8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:27.815962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 126/248] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:27 2022] GET /identity/v3/role_assignments?user.id=dfc5ebbe127b443c970bc0569b9a376a&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=a0dae20055d1456ba8d94cfec7d62668 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:27.903167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5021b93-afd5-4391-9c1e-06eb12c16e69 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:27.905829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:27.944966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca0bad-3527-49b9-b987-3f4096e16eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:27.944966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0bad-3527-49b9-b987-3f4096e16eef None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:27.944966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0bad-3527-49b9-b987-3f4096e16eef None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:27.944966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ca0bad-3527-49b9-b987-3f4096e16eef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:27.957142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ca0bad-3527-49b9-b987-3f4096e16eef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-76ca0bad-3527-49b9-b987-3f4096e16eef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:27.965053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:27.966515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:27.967819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 123/249] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:27.973068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc1f13-69c4-493e-bf49-03c7d092a3c8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:28.089053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc1f13-69c4-493e-bf49-03c7d092a3c8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:28.131168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a4d77-7706-41dd-bbae-706b5df2606b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:28.132222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a4d77-7706-41dd-bbae-706b5df2606b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:28.132706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a4d77-7706-41dd-bbae-706b5df2606b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:28.133177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a4d77-7706-41dd-bbae-706b5df2606b None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:28.134127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a4d77-7706-41dd-bbae-706b5df2606b None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:28.134654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a4d77-7706-41dd-bbae-706b5df2606b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:28.136278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a4d77-7706-41dd-bbae-706b5df2606b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:28.151002 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 127/250] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:28.156369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca0bad-3527-49b9-b987-3f4096e16eef None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:28.282783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ca0bad-3527-49b9-b987-3f4096e16eef None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:28.323865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac099b76-6d07-444b-9a73-0293f3416466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:28.324771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac099b76-6d07-444b-9a73-0293f3416466 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:28.325050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac099b76-6d07-444b-9a73-0293f3416466 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:28.325376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac099b76-6d07-444b-9a73-0293f3416466 None admin] PATH_INFO: `/v3/users/8d2bc038d5134d8d92e90f5e55081340` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:28.332724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac099b76-6d07-444b-9a73-0293f3416466 None admin] RBAC: Authorizing `identity:get_user(user_id=8d2bc038d5134d8d92e90f5e55081340)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:28.334212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac099b76-6d07-444b-9a73-0293f3416466 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:28.335969 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 124/251] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:28 2022] GET /identity/v3/users/8d2bc038d5134d8d92e90f5e55081340 => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:28.342048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a4d77-7706-41dd-bbae-706b5df2606b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:28.370208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:28.445560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee148f67-a752-4577-bce9-5c14a7b2cf9f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:28.445868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee148f67-a752-4577-bce9-5c14a7b2cf9f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:28.446124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee148f67-a752-4577-bce9-5c14a7b2cf9f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:28.448016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 125/252] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:28.467588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9d4d-6062-4fa5-b69b-236d65dec3de None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:28.467895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9d4d-6062-4fa5-b69b-236d65dec3de None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:28.468170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2f9d4d-6062-4fa5-b69b-236d65dec3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:28.496113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-eb2f9d4d-6062-4fa5-b69b-236d65dec3de None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:28.497372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eb2f9d4d-6062-4fa5-b69b-236d65dec3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:28.524179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a4d77-7706-41dd-bbae-706b5df2606b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:28.547703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:28.594182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac367b0-c6e4-46f5-b08a-2b0a55540997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:28.594991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac367b0-c6e4-46f5-b08a-2b0a55540997 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:28.595280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac367b0-c6e4-46f5-b08a-2b0a55540997 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:28.595558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac367b0-c6e4-46f5-b08a-2b0a55540997 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:28.600785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac367b0-c6e4-46f5-b08a-2b0a55540997 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:28.602461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac367b0-c6e4-46f5-b08a-2b0a55540997 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:28.604422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 128/253] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:28 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:28.611122 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac367b0-c6e4-46f5-b08a-2b0a55540997 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:28.659866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 126/254] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:28.688437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f9d4d-6062-4fa5-b69b-236d65dec3de None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:28.740527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:28.770270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac367b0-c6e4-46f5-b08a-2b0a55540997 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:28.833964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eda5a-7390-4d05-ba57-edbb3af70bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:28.835367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eda5a-7390-4d05-ba57-edbb3af70bdb None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:28.835938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eda5a-7390-4d05-ba57-edbb3af70bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:28.836417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7eda5a-7390-4d05-ba57-edbb3af70bdb None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d/users/8d2bc038d5134d8d92e90f5e55081340/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:28.852894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7eda5a-7390-4d05-ba57-edbb3af70bdb None admin] RBAC: Authorizing `identity:create_grant(project_id=18d10b4af4be46f482585d23de6e290d, user_id=8d2bc038d5134d8d92e90f5e55081340, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:28.854700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7eda5a-7390-4d05-ba57-edbb3af70bdb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:28.896785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2f9d4d-6062-4fa5-b69b-236d65dec3de None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:28.941007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9d5fc-b8c2-4105-a6e1-9c7034937149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:28.941881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9d5fc-b8c2-4105-a6e1-9c7034937149 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:28.942169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9d5fc-b8c2-4105-a6e1-9c7034937149 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:28.942444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9d5fc-b8c2-4105-a6e1-9c7034937149 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:28.954130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9d5fc-b8c2-4105-a6e1-9c7034937149 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:28.957060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 129/255] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:49:28 2022] PUT /identity/v3/projects/18d10b4af4be46f482585d23de6e290d/users/8d2bc038d5134d8d92e90f5e55081340/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-85e9d5fc-b8c2-4105-a6e1-9c7034937149 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:28.962429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:28.963355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:28.964199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 127/256] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:49:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:28.972779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eda5a-7390-4d05-ba57-edbb3af70bdb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:29.120058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7eda5a-7390-4d05-ba57-edbb3af70bdb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:29.186674 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34cbcd-5706-42ce-b341-435b41fea3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:29.187672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34cbcd-5706-42ce-b341-435b41fea3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:29.188164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34cbcd-5706-42ce-b341-435b41fea3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:29.188616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34cbcd-5706-42ce-b341-435b41fea3f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:29.189562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34cbcd-5706-42ce-b341-435b41fea3f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:29.190073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34cbcd-5706-42ce-b341-435b41fea3f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:29.191663 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34cbcd-5706-42ce-b341-435b41fea3f1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:29.197394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:29.206646 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 130/257] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:29.213161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9d5fc-b8c2-4105-a6e1-9c7034937149 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:29.240308 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:29.343178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9d5fc-b8c2-4105-a6e1-9c7034937149 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:29.383522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01931948-5f4b-496b-96a7-f9926db8ace2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:29.384339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01931948-5f4b-496b-96a7-f9926db8ace2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:29.384621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01931948-5f4b-496b-96a7-f9926db8ace2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:29.384891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01931948-5f4b-496b-96a7-f9926db8ace2 None admin] PATH_INFO: `/v3/users/47020c050032499bb962768e37e6018d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:29.386100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01931948-5f4b-496b-96a7-f9926db8ace2 None admin] RBAC: Authorizing `identity:get_user(user_id=47020c050032499bb962768e37e6018d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:29.388358 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01931948-5f4b-496b-96a7-f9926db8ace2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:29.390671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 128/258] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:29 2022] GET /identity/v3/users/47020c050032499bb962768e37e6018d => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:29.397015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34cbcd-5706-42ce-b341-435b41fea3f1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:29.508742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17e2c6-8b7b-4e25-8f01-c1517e970f6a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:29.509097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17e2c6-8b7b-4e25-8f01-c1517e970f6a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:29.509291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17e2c6-8b7b-4e25-8f01-c1517e970f6a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:29.510786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 129/259] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:29.517798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af359f-d267-4472-b1d1-b7e1ec31ee40 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:29.518098 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af359f-d267-4472-b1d1-b7e1ec31ee40 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:29.518361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af359f-d267-4472-b1d1-b7e1ec31ee40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:29.550266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a8af359f-d267-4472-b1d1-b7e1ec31ee40 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:29.552247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a8af359f-d267-4472-b1d1-b7e1ec31ee40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:29.567824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34cbcd-5706-42ce-b341-435b41fea3f1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:29.672714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf92992-8a94-4056-8106-d6626f10ffe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:29.672907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 130/260] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:29.674016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf92992-8a94-4056-8106-d6626f10ffe2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:29.674432 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf92992-8a94-4056-8106-d6626f10ffe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:29.674836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf92992-8a94-4056-8106-d6626f10ffe2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:29.714850 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af359f-d267-4472-b1d1-b7e1ec31ee40 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:29.739379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:29.836660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:29.843580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf92992-8a94-4056-8106-d6626f10ffe2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:29.845155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf92992-8a94-4056-8106-d6626f10ffe2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:29.887729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af359f-d267-4472-b1d1-b7e1ec31ee40 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:29.970003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6cdb8-d0fd-4d72-8dca-ed1996b40ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:29.971175 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6cdb8-d0fd-4d72-8dca-ed1996b40ded None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:29.971660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6cdb8-d0fd-4d72-8dca-ed1996b40ded None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:29.972161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd6cdb8-d0fd-4d72-8dca-ed1996b40ded None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:30.001321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd6cdb8-d0fd-4d72-8dca-ed1996b40ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-fcd6cdb8-d0fd-4d72-8dca-ed1996b40ded None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:30.019154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:30.020097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:30.020893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:30.026370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 131/261] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:30.032435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6cdb8-d0fd-4d72-8dca-ed1996b40ded None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:30.071071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 131/262] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 675 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:30.077567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf92992-8a94-4056-8106-d6626f10ffe2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:30.193095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:30.245747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd6cdb8-d0fd-4d72-8dca-ed1996b40ded None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:30.291009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:30.296683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf92992-8a94-4056-8106-d6626f10ffe2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:30.320083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afddce7-81f6-4972-8233-43b934de5c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:30.321008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afddce7-81f6-4972-8233-43b934de5c16 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:30.321295 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afddce7-81f6-4972-8233-43b934de5c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:30.321611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afddce7-81f6-4972-8233-43b934de5c16 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:30.322374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afddce7-81f6-4972-8233-43b934de5c16 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:30.322675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afddce7-81f6-4972-8233-43b934de5c16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:30.324335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afddce7-81f6-4972-8233-43b934de5c16 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:30.347899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 132/263] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:30.353482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afddce7-81f6-4972-8233-43b934de5c16 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:30.393579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c9524-a685-4b83-ad0f-a66f7aad158a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:30.394455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c9524-a685-4b83-ad0f-a66f7aad158a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:30.394732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c9524-a685-4b83-ad0f-a66f7aad158a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:30.395001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c9524-a685-4b83-ad0f-a66f7aad158a None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:30.397767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c9524-a685-4b83-ad0f-a66f7aad158a None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:30.411041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c9524-a685-4b83-ad0f-a66f7aad158a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:30.413927 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 132/264] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:30 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:30.429173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c9524-a685-4b83-ad0f-a66f7aad158a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:30.587949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afddce7-81f6-4972-8233-43b934de5c16 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:30.633980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97958909-0394-49dc-a1c0-12040425805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:30.634885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97958909-0394-49dc-a1c0-12040425805e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:30.635165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97958909-0394-49dc-a1c0-12040425805e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:30.635438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97958909-0394-49dc-a1c0-12040425805e None admin] PATH_INFO: `/v3/users/47020c050032499bb962768e37e6018d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:30.638739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97958909-0394-49dc-a1c0-12040425805e None admin] RBAC: Authorizing `identity:get_user(user_id=47020c050032499bb962768e37e6018d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:30.640220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97958909-0394-49dc-a1c0-12040425805e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:30.642277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 133/265] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:30 2022] GET /identity/v3/users/47020c050032499bb962768e37e6018d => generated 283 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:30.643306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656d600-b5a3-447f-afc4-8265fecd8cf8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:30.651948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656d600-b5a3-447f-afc4-8265fecd8cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:30.652414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b656d600-b5a3-447f-afc4-8265fecd8cf8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:30.654187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 134/266] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:30.656906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075275c8-9bca-46f0-b676-34181d84f86d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:30.657587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075275c8-9bca-46f0-b676-34181d84f86d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:30.659363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075275c8-9bca-46f0-b676-34181d84f86d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:30.661122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 135/267] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:30.663796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075275c8-9bca-46f0-b676-34181d84f86d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:30.670252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:30.682352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c9524-a685-4b83-ad0f-a66f7aad158a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:30.763264 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b4af23-7592-4789-a6b2-915bbd4a08b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:30.764419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4af23-7592-4789-a6b2-915bbd4a08b0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:30.764839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4af23-7592-4789-a6b2-915bbd4a08b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:30.765252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b4af23-7592-4789-a6b2-915bbd4a08b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:30.766466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4af23-7592-4789-a6b2-915bbd4a08b0 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=18d10b4af4be46f482585d23de6e290d, user.id=47020c050032499bb962768e37e6018d) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:30.768253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4af23-7592-4789-a6b2-915bbd4a08b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:30.771673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b4af23-7592-4789-a6b2-915bbd4a08b0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:30.790947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 133/268] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:30 2022] GET /identity/v3/role_assignments?user.id=47020c050032499bb962768e37e6018d&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 608 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:30.793685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f851f46-d338-4209-98d6-e82088d6f5cc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:30.793685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f851f46-d338-4209-98d6-e82088d6f5cc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:30.795969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f851f46-d338-4209-98d6-e82088d6f5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:30.838344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6f851f46-d338-4209-98d6-e82088d6f5cc None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:30.839851 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6f851f46-d338-4209-98d6-e82088d6f5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:30.889534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:30.895458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075275c8-9bca-46f0-b676-34181d84f86d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:30.949936 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3569d-cba4-40fb-9b88-1a3ac4d079af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:30.951516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3569d-cba4-40fb-9b88-1a3ac4d079af None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:30.952027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3569d-cba4-40fb-9b88-1a3ac4d079af None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:30.954016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3569d-cba4-40fb-9b88-1a3ac4d079af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:30.999079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 134/269] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:31.000866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4ad9-0420-4460-bcdf-44bcdb63e1c7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.002597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4ad9-0420-4460-bcdf-44bcdb63e1c7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.002875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f4ad9-0420-4460-bcdf-44bcdb63e1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.042070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3e6f4ad9-0420-4460-bcdf-44bcdb63e1c7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:31.043301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3e6f4ad9-0420-4460-bcdf-44bcdb63e1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:31.086068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3569d-cba4-40fb-9b88-1a3ac4d079af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:31.087542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3569d-cba4-40fb-9b88-1a3ac4d079af None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:31.089599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:31.146177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 135/270] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:31.147811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5d538-0c14-43af-b89c-5d02a9af61d2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.148129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5d538-0c14-43af-b89c-5d02a9af61d2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.148405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5d538-0c14-43af-b89c-5d02a9af61d2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.149847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 136/271] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:31.152680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5d538-0c14-43af-b89c-5d02a9af61d2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:31.217540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 136/272] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:31.223850 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e7d73-1fd0-4d63-9ed0-06f2d3776631 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.224368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e7d73-1fd0-4d63-9ed0-06f2d3776631 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.224826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93e7d73-1fd0-4d63-9ed0-06f2d3776631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.242497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e93e7d73-1fd0-4d63-9ed0-06f2d3776631 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:31.244242 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e93e7d73-1fd0-4d63-9ed0-06f2d3776631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:31.254291 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:31.265553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5d538-0c14-43af-b89c-5d02a9af61d2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:31.300954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3f274-2877-46a5-908a-a0f2b3fdda53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:31.301738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3f274-2877-46a5-908a-a0f2b3fdda53 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.302019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3f274-2877-46a5-908a-a0f2b3fdda53 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.302471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e3f274-2877-46a5-908a-a0f2b3fdda53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.313906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e3f274-2877-46a5-908a-a0f2b3fdda53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:31.323230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 137/273] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:31.323230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e7d73-1fd0-4d63-9ed0-06f2d3776631 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d9e3f274-2877-46a5-908a-a0f2b3fdda53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:31.323447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:31.324525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 137/274] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:31.325612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3f274-2877-46a5-908a-a0f2b3fdda53 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:31.362367 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:31.434538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93e7d73-1fd0-4d63-9ed0-06f2d3776631 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:31.438767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e3f274-2877-46a5-908a-a0f2b3fdda53 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:31.471688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2883d18-9a82-41bb-810f-983d544ff5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:31.472559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2883d18-9a82-41bb-810f-983d544ff5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.472798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2883d18-9a82-41bb-810f-983d544ff5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.473066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2883d18-9a82-41bb-810f-983d544ff5e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.474332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2883d18-9a82-41bb-810f-983d544ff5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:31.474444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59697a2d-9b88-411d-980a-1cdc1826a75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:31.475277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59697a2d-9b88-411d-980a-1cdc1826a75e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.475559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59697a2d-9b88-411d-980a-1cdc1826a75e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.475788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2883d18-9a82-41bb-810f-983d544ff5e0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:31.475877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59697a2d-9b88-411d-980a-1cdc1826a75e None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.477041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59697a2d-9b88-411d-980a-1cdc1826a75e None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:31.482667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 138/275] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:31.482667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2883d18-9a82-41bb-810f-983d544ff5e0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:31.482852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59697a2d-9b88-411d-980a-1cdc1826a75e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:31.482852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 138/276] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:31 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:31.482852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59697a2d-9b88-411d-980a-1cdc1826a75e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:31.504796 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:31.585669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:31.588524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2883d18-9a82-41bb-810f-983d544ff5e0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:31.595662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59697a2d-9b88-411d-980a-1cdc1826a75e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:31.623416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773db22a-2d9d-406d-bef3-7ace388f0278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:31.624046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db22a-2d9d-406d-bef3-7ace388f0278 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.624329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db22a-2d9d-406d-bef3-7ace388f0278 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.624605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db22a-2d9d-406d-bef3-7ace388f0278 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.625365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773db22a-2d9d-406d-bef3-7ace388f0278 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:31.626109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773db22a-2d9d-406d-bef3-7ace388f0278 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:31.628055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773db22a-2d9d-406d-bef3-7ace388f0278 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:31.630745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684b245-8b75-4118-8aa2-a18ef72690f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:31.631607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684b245-8b75-4118-8aa2-a18ef72690f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.631891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684b245-8b75-4118-8aa2-a18ef72690f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.632191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684b245-8b75-4118-8aa2-a18ef72690f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.637065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 139/277] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:31.638195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773db22a-2d9d-406d-bef3-7ace388f0278 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:31.648131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684b245-8b75-4118-8aa2-a18ef72690f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2684b245-8b75-4118-8aa2-a18ef72690f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:31.656744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:31.657664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:31.658445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 139/278] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:31.659104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684b245-8b75-4118-8aa2-a18ef72690f1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:31.739702 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:31.752684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773db22a-2d9d-406d-bef3-7ace388f0278 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:31.761495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684b245-8b75-4118-8aa2-a18ef72690f1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:31.787471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0c87d-d2c0-423e-bd57-8cf2ca475cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:31.788175 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0c87d-d2c0-423e-bd57-8cf2ca475cd4 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.788458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0c87d-d2c0-423e-bd57-8cf2ca475cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.788728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0c87d-d2c0-423e-bd57-8cf2ca475cd4 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.789438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0c87d-d2c0-423e-bd57-8cf2ca475cd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:31.790880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0c87d-d2c0-423e-bd57-8cf2ca475cd4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:31.796900 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5704c35-a862-400f-a07b-250ca47c57ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:31.797552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5704c35-a862-400f-a07b-250ca47c57ce None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.797836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5704c35-a862-400f-a07b-250ca47c57ce None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.798471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5704c35-a862-400f-a07b-250ca47c57ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.798933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5704c35-a862-400f-a07b-250ca47c57ce None admin] RBAC: Adding query filter params (role.id=5b16ed690a6942c288df268569b6ab85, scope.project.id=18d10b4af4be46f482585d23de6e290d, user.id=47020c050032499bb962768e37e6018d) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:31.799250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5704c35-a862-400f-a07b-250ca47c57ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:31.800738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5704c35-a862-400f-a07b-250ca47c57ce None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:31.806615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 140/279] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:31 2022] GET /identity/v3/role_assignments?user.id=47020c050032499bb962768e37e6018d&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=5b16ed690a6942c288df268569b6ab85 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:31.807393 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5704c35-a862-400f-a07b-250ca47c57ce None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:31.921915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5704c35-a862-400f-a07b-250ca47c57ce None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:31.936631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 140/280] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:31 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:31.938163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0c87d-d2c0-423e-bd57-8cf2ca475cd4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:31.977760 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75215f0-76cb-4bd8-9b40-a530d66364fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:31.978687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:31.979006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75215f0-76cb-4bd8-9b40-a530d66364fa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:31.979572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75215f0-76cb-4bd8-9b40-a530d66364fa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:31.979572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75215f0-76cb-4bd8-9b40-a530d66364fa None admin] PATH_INFO: `/v3/users/fe7eda6e56ae4c0b996f3a0d826fa37b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:31.994567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:32.001795 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75215f0-76cb-4bd8-9b40-a530d66364fa None admin] RBAC: Authorizing `identity:get_user(user_id=fe7eda6e56ae4c0b996f3a0d826fa37b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:32.001795 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75215f0-76cb-4bd8-9b40-a530d66364fa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:32.008272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 141/281] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:31 2022] GET /identity/v3/users/fe7eda6e56ae4c0b996f3a0d826fa37b => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:32.008272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694567-f7d2-481a-b48d-75e157976b88 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:32.008272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694567-f7d2-481a-b48d-75e157976b88 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:32.008272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3694567-f7d2-481a-b48d-75e157976b88 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:32.008272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 142/282] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:32.011969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694567-f7d2-481a-b48d-75e157976b88 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:32.112379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0c87d-d2c0-423e-bd57-8cf2ca475cd4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:32.150566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3694567-f7d2-481a-b48d-75e157976b88 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:32.158769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e4e198-8a56-496b-bbe5-f18120bea972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:32.159535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4e198-8a56-496b-bbe5-f18120bea972 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:32.159891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4e198-8a56-496b-bbe5-f18120bea972 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:32.160250 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e4e198-8a56-496b-bbe5-f18120bea972 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:32.161018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4e198-8a56-496b-bbe5-f18120bea972 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:32.161332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4e198-8a56-496b-bbe5-f18120bea972 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:32.162754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e4e198-8a56-496b-bbe5-f18120bea972 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:32.172959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 141/283] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:32.174164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254dc61-3f8b-43ba-9b91-0f4a7ea39ec1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:32.174456 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254dc61-3f8b-43ba-9b91-0f4a7ea39ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:32.174736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254dc61-3f8b-43ba-9b91-0f4a7ea39ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:32.197118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0254dc61-3f8b-43ba-9b91-0f4a7ea39ec1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:32.198347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0254dc61-3f8b-43ba-9b91-0f4a7ea39ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:32.200589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6ebbb-c63a-45f5-8aac-f571640eb036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:32.201684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6ebbb-c63a-45f5-8aac-f571640eb036 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:32.202192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6ebbb-c63a-45f5-8aac-f571640eb036 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:32.202469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6ebbb-c63a-45f5-8aac-f571640eb036 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:32.204344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6ebbb-c63a-45f5-8aac-f571640eb036 None admin] RBAC: Adding query filter params (role.id=36dde009f57f45dd9ded880f26a9b2cc, user.id=fe7eda6e56ae4c0b996f3a0d826fa37b, scope.system=all) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:32.204662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6ebbb-c63a-45f5-8aac-f571640eb036 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:32.206253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed6ebbb-c63a-45f5-8aac-f571640eb036 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:32.212996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 143/284] 10.222.0.85 () {56 vars in 1308 bytes} [Wed Jul 20 21:49:32 2022] GET /identity/v3/role_assignments?user.id=fe7eda6e56ae4c0b996f3a0d826fa37b&scope.system=all&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:32.213800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6ebbb-c63a-45f5-8aac-f571640eb036 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:32.306238 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 142/285] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:32.315435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:32.332355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254dc61-3f8b-43ba-9b91-0f4a7ea39ec1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:32.352372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:32.363295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6ebbb-c63a-45f5-8aac-f571640eb036 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:32.414077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f03916-c633-4b4e-996f-e2ca66693210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:32.415113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03916-c633-4b4e-996f-e2ca66693210 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:32.415394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03916-c633-4b4e-996f-e2ca66693210 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:32.415664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f03916-c633-4b4e-996f-e2ca66693210 None admin] PATH_INFO: `/v3/users/dfc5ebbe127b443c970bc0569b9a376a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:32.417727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f03916-c633-4b4e-996f-e2ca66693210 None admin] RBAC: Authorizing `identity:get_user(user_id=dfc5ebbe127b443c970bc0569b9a376a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:32.420027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f03916-c633-4b4e-996f-e2ca66693210 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:32.422679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 144/286] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:32 2022] GET /identity/v3/users/dfc5ebbe127b443c970bc0569b9a376a => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:32.429116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f03916-c633-4b4e-996f-e2ca66693210 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:32.454799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254dc61-3f8b-43ba-9b91-0f4a7ea39ec1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:32.494917 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93977bc7-33cb-42ea-ba9a-9a0383007a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:32.496307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977bc7-33cb-42ea-ba9a-9a0383007a6b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:32.496687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977bc7-33cb-42ea-ba9a-9a0383007a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:32.497836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977bc7-33cb-42ea-ba9a-9a0383007a6b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:32.512201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93977bc7-33cb-42ea-ba9a-9a0383007a6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-93977bc7-33cb-42ea-ba9a-9a0383007a6b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:32.523143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:32.524136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:32.524943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:32.525556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 143/287] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:32.531060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93977bc7-33cb-42ea-ba9a-9a0383007a6b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:32.565598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f03916-c633-4b4e-996f-e2ca66693210 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:32.627445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:32.636980 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d570f-37fc-4dca-a7da-d6fdcf7d42e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:32.641815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d570f-37fc-4dca-a7da-d6fdcf7d42e0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:32.641815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d570f-37fc-4dca-a7da-d6fdcf7d42e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:32.641815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d570f-37fc-4dca-a7da-d6fdcf7d42e0 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:32.644577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d570f-37fc-4dca-a7da-d6fdcf7d42e0 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:32.646251 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d570f-37fc-4dca-a7da-d6fdcf7d42e0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:32.649539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 145/288] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:32 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:32.656740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d570f-37fc-4dca-a7da-d6fdcf7d42e0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:32.672307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:32.723679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93977bc7-33cb-42ea-ba9a-9a0383007a6b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:32.772359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cf507-4411-449b-b378-70cadec8d1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:32.773323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cf507-4411-449b-b378-70cadec8d1f8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:32.773630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cf507-4411-449b-b378-70cadec8d1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:32.773906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957cf507-4411-449b-b378-70cadec8d1f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:32.774798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cf507-4411-449b-b378-70cadec8d1f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:32.775108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cf507-4411-449b-b378-70cadec8d1f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:32.776877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957cf507-4411-449b-b378-70cadec8d1f8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:32.791478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 144/289] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:32.797681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cf507-4411-449b-b378-70cadec8d1f8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:32.850871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d570f-37fc-4dca-a7da-d6fdcf7d42e0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:32.922000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b59eab-96a3-4514-b110-be5c50d17980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:32.922905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b59eab-96a3-4514-b110-be5c50d17980 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:32.923182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b59eab-96a3-4514-b110-be5c50d17980 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:32.923456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b59eab-96a3-4514-b110-be5c50d17980 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d/users/dfc5ebbe127b443c970bc0569b9a376a/roles/a0dae20055d1456ba8d94cfec7d62668` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:32.934005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b59eab-96a3-4514-b110-be5c50d17980 None admin] RBAC: Authorizing `identity:create_grant(project_id=18d10b4af4be46f482585d23de6e290d, user_id=dfc5ebbe127b443c970bc0569b9a376a, role_id=a0dae20055d1456ba8d94cfec7d62668)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:32.935990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b59eab-96a3-4514-b110-be5c50d17980 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:32.974203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957cf507-4411-449b-b378-70cadec8d1f8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:33.004566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:33.009732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9f1f-5ee3-4a30-915a-2672b42d5b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:33.010611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9f1f-5ee3-4a30-915a-2672b42d5b7f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:33.010942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9f1f-5ee3-4a30-915a-2672b42d5b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:33.011217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c9f1f-5ee3-4a30-915a-2672b42d5b7f None admin] PATH_INFO: `/v3/users/8d2bc038d5134d8d92e90f5e55081340` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:33.012460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9f1f-5ee3-4a30-915a-2672b42d5b7f None admin] RBAC: Authorizing `identity:get_user(user_id=8d2bc038d5134d8d92e90f5e55081340)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:33.014578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c9f1f-5ee3-4a30-915a-2672b42d5b7f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:33.017028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 145/290] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:32 2022] GET /identity/v3/users/8d2bc038d5134d8d92e90f5e55081340 => generated 297 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:33.020421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 146/291] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:49:32 2022] PUT /identity/v3/projects/18d10b4af4be46f482585d23de6e290d/users/dfc5ebbe127b443c970bc0569b9a376a/roles/a0dae20055d1456ba8d94cfec7d62668 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 21:49:33.022461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9f1f-5ee3-4a30-915a-2672b42d5b7f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:33.136458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c9f1f-5ee3-4a30-915a-2672b42d5b7f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:33.173515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53396ad8-51d5-4ad5-a84b-651e5e075795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:33.174165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53396ad8-51d5-4ad5-a84b-651e5e075795 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:33.174446 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53396ad8-51d5-4ad5-a84b-651e5e075795 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:33.174724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53396ad8-51d5-4ad5-a84b-651e5e075795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:33.245886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:33.249043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53396ad8-51d5-4ad5-a84b-651e5e075795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:33.250517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53396ad8-51d5-4ad5-a84b-651e5e075795 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:33.360157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 146/292] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:33.361732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b59eab-96a3-4514-b110-be5c50d17980 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:33.423944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:33.465641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b59eab-96a3-4514-b110-be5c50d17980 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:33.504536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed66c3b-9b73-4832-b6fc-726a2760084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:33.505308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed66c3b-9b73-4832-b6fc-726a2760084c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:33.505588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed66c3b-9b73-4832-b6fc-726a2760084c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:33.505863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed66c3b-9b73-4832-b6fc-726a2760084c None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:33.507072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed66c3b-9b73-4832-b6fc-726a2760084c None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:33.508554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed66c3b-9b73-4832-b6fc-726a2760084c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:33.510258 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 147/293] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:33 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:33.516870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53396ad8-51d5-4ad5-a84b-651e5e075795 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:33.625730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53396ad8-51d5-4ad5-a84b-651e5e075795 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:33.627380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:33.664764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5d8e9-01f7-4fb5-bbc8-7bab53b0f38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:33.665422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d8e9-01f7-4fb5-bbc8-7bab53b0f38c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:33.665703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d8e9-01f7-4fb5-bbc8-7bab53b0f38c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:33.665978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5d8e9-01f7-4fb5-bbc8-7bab53b0f38c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:33.666821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5d8e9-01f7-4fb5-bbc8-7bab53b0f38c None admin] RBAC: Adding query filter params (role.id=36dde009f57f45dd9ded880f26a9b2cc, scope.project.id=18d10b4af4be46f482585d23de6e290d, user.id=8d2bc038d5134d8d92e90f5e55081340) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:33.667130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5d8e9-01f7-4fb5-bbc8-7bab53b0f38c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:33.668647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5d8e9-01f7-4fb5-bbc8-7bab53b0f38c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:33.675885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 147/294] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:33 2022] GET /identity/v3/role_assignments?user.id=8d2bc038d5134d8d92e90f5e55081340&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:34.538608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ee081-d563-4e6a-89eb-8806dbbfd0a4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:34.539142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ee081-d563-4e6a-89eb-8806dbbfd0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:34.539142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736ee081-d563-4e6a-89eb-8806dbbfd0a4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:34.540775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 148/295] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:34.547204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814c69-8675-4df7-9adb-6f12afea514c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:34.547613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814c69-8675-4df7-9adb-6f12afea514c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:34.547817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a814c69-8675-4df7-9adb-6f12afea514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:34.565342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9a814c69-8675-4df7-9adb-6f12afea514c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:34.566536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9a814c69-8675-4df7-9adb-6f12afea514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:34.591507 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920baa6-35e3-4c91-b4b9-ec65a17fc7e9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:34.591979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920baa6-35e3-4c91-b4b9-ec65a17fc7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:34.592170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920baa6-35e3-4c91-b4b9-ec65a17fc7e9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:34.593793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 149/296] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:34.598882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563118c-f295-4e21-920d-a097565e1cda None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:34.599435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563118c-f295-4e21-920d-a097565e1cda None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:34.599831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9563118c-f295-4e21-920d-a097565e1cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:34.618651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9563118c-f295-4e21-920d-a097565e1cda None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:34.620195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9563118c-f295-4e21-920d-a097565e1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:34.646155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 148/297] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:34.672230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814c69-8675-4df7-9adb-6f12afea514c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:34.703942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 150/298] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:34.726953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563118c-f295-4e21-920d-a097565e1cda None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:34.784437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:34.802560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a814c69-8675-4df7-9adb-6f12afea514c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:34.802711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:34.827226 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff139a65-c9e1-4e83-9dfe-e50f970db760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:34.828666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139a65-c9e1-4e83-9dfe-e50f970db760 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:34.828951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139a65-c9e1-4e83-9dfe-e50f970db760 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:34.829227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff139a65-c9e1-4e83-9dfe-e50f970db760 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:34.830438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff139a65-c9e1-4e83-9dfe-e50f970db760 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:34.831881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff139a65-c9e1-4e83-9dfe-e50f970db760 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:34.833865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 149/299] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:34.836993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9563118c-f295-4e21-920d-a097565e1cda None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:34.837539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c07d-321a-45e6-bda8-1a71e964f65e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:34.838099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c07d-321a-45e6-bda8-1a71e964f65e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:34.838758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b0c07d-321a-45e6-bda8-1a71e964f65e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:34.840242 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 150/300] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:34.841369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0c07d-321a-45e6-bda8-1a71e964f65e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:34.881745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a520b8-2125-4f20-970f-df3b3f03558c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:34.882593 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a520b8-2125-4f20-970f-df3b3f03558c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:34.882892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a520b8-2125-4f20-970f-df3b3f03558c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:34.883135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a520b8-2125-4f20-970f-df3b3f03558c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:34.894296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a520b8-2125-4f20-970f-df3b3f03558c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b0a520b8-2125-4f20-970f-df3b3f03558c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:34.902079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:34.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:34.904306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 151/301] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:34.905564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a6970-ac14-42c6-b5c7-c38067e92c85 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:34.905564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a6970-ac14-42c6-b5c7-c38067e92c85 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:34.905730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a6970-ac14-42c6-b5c7-c38067e92c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:34.923190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b91a6970-ac14-42c6-b5c7-c38067e92c85 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:34.924423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b91a6970-ac14-42c6-b5c7-c38067e92c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:34.966189 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b0c07d-321a-45e6-bda8-1a71e964f65e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:35.004307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fbcac-9fa1-4753-844a-744ac7238629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:35.004971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fbcac-9fa1-4753-844a-744ac7238629 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.005422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fbcac-9fa1-4753-844a-744ac7238629 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.005691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fbcac-9fa1-4753-844a-744ac7238629 None admin] PATH_INFO: `/v3/groups` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.006369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fbcac-9fa1-4753-844a-744ac7238629 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:35.007402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 152/302] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:35.008030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a6970-ac14-42c6-b5c7-c38067e92c85 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:35.016702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fbcac-9fa1-4753-844a-744ac7238629 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:35.060776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:35.088941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 151/303] 10.222.0.85 () {60 vars in 1134 bytes} [Wed Jul 20 21:49:34 2022] POST /identity/v3/groups => generated 229 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:35.089908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fbcac-9fa1-4753-844a-744ac7238629 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:35.131373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91a6970-ac14-42c6-b5c7-c38067e92c85 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:35.133261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:35.184757 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3813d6-94d6-463e-af56-e4b03ed58efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:35.186044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3813d6-94d6-463e-af56-e4b03ed58efa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.186339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3813d6-94d6-463e-af56-e4b03ed58efa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.186615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3813d6-94d6-463e-af56-e4b03ed58efa None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.187688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3813d6-94d6-463e-af56-e4b03ed58efa None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:35.188022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3813d6-94d6-463e-af56-e4b03ed58efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:35.189466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3813d6-94d6-463e-af56-e4b03ed58efa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:35.204087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 153/304] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:35.209455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3813d6-94d6-463e-af56-e4b03ed58efa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:35.238638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fbcac-9fa1-4753-844a-744ac7238629 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:35.286540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645097fb-5549-4a04-bdb8-24a2f2969e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:35.287742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645097fb-5549-4a04-bdb8-24a2f2969e90 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.288223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645097fb-5549-4a04-bdb8-24a2f2969e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.288632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645097fb-5549-4a04-bdb8-24a2f2969e90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.300118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645097fb-5549-4a04-bdb8-24a2f2969e90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-645097fb-5549-4a04-bdb8-24a2f2969e90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:35.308265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:35.309276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:35.310693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 152/305] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:35.317527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645097fb-5549-4a04-bdb8-24a2f2969e90 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:35.338794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3813d6-94d6-463e-af56-e4b03ed58efa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:35.354101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:35.391026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4eba1-8000-41fb-b3bf-ec7801ed5f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:35.392112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4eba1-8000-41fb-b3bf-ec7801ed5f56 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.392788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4eba1-8000-41fb-b3bf-ec7801ed5f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.393168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4eba1-8000-41fb-b3bf-ec7801ed5f56 None admin] PATH_INFO: `/v3/users/fe7eda6e56ae4c0b996f3a0d826fa37b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.395090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4eba1-8000-41fb-b3bf-ec7801ed5f56 None admin] RBAC: Authorizing `identity:get_user(user_id=fe7eda6e56ae4c0b996f3a0d826fa37b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:35.396973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb4eba1-8000-41fb-b3bf-ec7801ed5f56 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:35.400248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 154/306] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:35 2022] GET /identity/v3/users/fe7eda6e56ae4c0b996f3a0d826fa37b => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:35.409401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4eba1-8000-41fb-b3bf-ec7801ed5f56 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:35.411674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:35.429990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645097fb-5549-4a04-bdb8-24a2f2969e90 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:35.465749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33857be4-9617-4058-acfa-f07ae078ebc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:35.466413 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33857be4-9617-4058-acfa-f07ae078ebc2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.466689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33857be4-9617-4058-acfa-f07ae078ebc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.466957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33857be4-9617-4058-acfa-f07ae078ebc2 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.467707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33857be4-9617-4058-acfa-f07ae078ebc2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:35.468049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33857be4-9617-4058-acfa-f07ae078ebc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:35.469421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33857be4-9617-4058-acfa-f07ae078ebc2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:35.478129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 153/307] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:35.479469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608ef9-2939-4fa4-9e2e-e3db0a680d94 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.479758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608ef9-2939-4fa4-9e2e-e3db0a680d94 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.480055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e608ef9-2939-4fa4-9e2e-e3db0a680d94 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.481477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 154/308] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:35.483476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e608ef9-2939-4fa4-9e2e-e3db0a680d94 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:35.535096 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4eba1-8000-41fb-b3bf-ec7801ed5f56 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:35.573451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8628db-22b6-4c78-8b12-fc86bc5d21de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:35.574229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8628db-22b6-4c78-8b12-fc86bc5d21de None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.574509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8628db-22b6-4c78-8b12-fc86bc5d21de None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.574785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8628db-22b6-4c78-8b12-fc86bc5d21de None admin] PATH_INFO: `/v3/system/users/fe7eda6e56ae4c0b996f3a0d826fa37b/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.576918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8628db-22b6-4c78-8b12-fc86bc5d21de None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fe7eda6e56ae4c0b996f3a0d826fa37b, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:35.578299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8628db-22b6-4c78-8b12-fc86bc5d21de None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:35.593976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e608ef9-2939-4fa4-9e2e-e3db0a680d94 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:35.626954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1779bf0-86c0-4e09-8c6a-2b70736c1a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:35.627813 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779bf0-86c0-4e09-8c6a-2b70736c1a67 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.628115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779bf0-86c0-4e09-8c6a-2b70736c1a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.628387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1779bf0-86c0-4e09-8c6a-2b70736c1a67 None admin] PATH_INFO: `/v3/users/85d7f1062f614bd99fa0eaef81828633` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.642751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1779bf0-86c0-4e09-8c6a-2b70736c1a67 None admin] RBAC: Authorizing `identity:get_user(user_id=85d7f1062f614bd99fa0eaef81828633)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:35.644237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1779bf0-86c0-4e09-8c6a-2b70736c1a67 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:35.647689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 155/309] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:35 2022] GET /identity/v3/users/85d7f1062f614bd99fa0eaef81828633 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:35.647689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad9045-8a8b-488c-833e-6df669df449e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.647689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad9045-8a8b-488c-833e-6df669df449e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.647689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ad9045-8a8b-488c-833e-6df669df449e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.652237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:35.663613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a8ad9045-8a8b-488c-833e-6df669df449e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:35.664836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a8ad9045-8a8b-488c-833e-6df669df449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:35.675950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 155/310] 10.222.0.85 () {58 vars in 1334 bytes} [Wed Jul 20 21:49:35 2022] PUT /identity/v3/system/users/fe7eda6e56ae4c0b996f3a0d826fa37b/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 21:49:35.675950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8628db-22b6-4c78-8b12-fc86bc5d21de None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:35.746040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:35.751184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 156/311] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:35.776640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad9045-8a8b-488c-833e-6df669df449e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:35.835244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8628db-22b6-4c78-8b12-fc86bc5d21de None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:35.883412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4f8e0-0fd5-45d6-8420-7841fff14973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:35.884159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f8e0-0fd5-45d6-8420-7841fff14973 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.884880 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f8e0-0fd5-45d6-8420-7841fff14973 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.885166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b4f8e0-0fd5-45d6-8420-7841fff14973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.886003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4f8e0-0fd5-45d6-8420-7841fff14973 None admin] RBAC: Adding query filter params (role.id=a0dae20055d1456ba8d94cfec7d62668, user.id=85d7f1062f614bd99fa0eaef81828633, scope.system=all) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:35.886318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4f8e0-0fd5-45d6-8420-7841fff14973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:35.888218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b4f8e0-0fd5-45d6-8420-7841fff14973 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:35.896213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 156/312] 10.222.0.85 () {56 vars in 1308 bytes} [Wed Jul 20 21:49:35 2022] GET /identity/v3/role_assignments?user.id=85d7f1062f614bd99fa0eaef81828633&scope.system=all&role.id=a0dae20055d1456ba8d94cfec7d62668 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:35.923204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ad9045-8a8b-488c-833e-6df669df449e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:35.962977 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21609cf9-916c-4d17-bf9b-7f6cd79c9f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:35.963620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21609cf9-916c-4d17-bf9b-7f6cd79c9f6b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:35.963899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21609cf9-916c-4d17-bf9b-7f6cd79c9f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:35.964208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21609cf9-916c-4d17-bf9b-7f6cd79c9f6b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:35.976451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21609cf9-916c-4d17-bf9b-7f6cd79c9f6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-21609cf9-916c-4d17-bf9b-7f6cd79c9f6b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:35.985193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:35.986237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:35.987040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:35.988234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 157/313] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:35.992504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4f8e0-0fd5-45d6-8420-7841fff14973 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:36.108312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b4f8e0-0fd5-45d6-8420-7841fff14973 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:36.115453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:36.145389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfddc4b-f85d-4344-9f3b-a6233f16d4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:36.146424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfddc4b-f85d-4344-9f3b-a6233f16d4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:36.146891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfddc4b-f85d-4344-9f3b-a6233f16d4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:36.147383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfddc4b-f85d-4344-9f3b-a6233f16d4d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:36.148175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfddc4b-f85d-4344-9f3b-a6233f16d4d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:36.148488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfddc4b-f85d-4344-9f3b-a6233f16d4d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:36.149892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfddc4b-f85d-4344-9f3b-a6233f16d4d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:36.159792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 157/314] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:36.165100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21609cf9-916c-4d17-bf9b-7f6cd79c9f6b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:36.279268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21609cf9-916c-4d17-bf9b-7f6cd79c9f6b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:36.315033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9753-ecce-400f-a929-063148c74e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:36.315951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9753-ecce-400f-a929-063148c74e4f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:36.316252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9753-ecce-400f-a929-063148c74e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:36.316532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9c9753-ecce-400f-a929-063148c74e4f None admin] PATH_INFO: `/v3/users/dfc5ebbe127b443c970bc0569b9a376a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:36.317802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9753-ecce-400f-a929-063148c74e4f None admin] RBAC: Authorizing `identity:get_user(user_id=dfc5ebbe127b443c970bc0569b9a376a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:36.319298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9c9753-ecce-400f-a929-063148c74e4f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:36.321301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 158/315] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:36 2022] GET /identity/v3/users/dfc5ebbe127b443c970bc0569b9a376a => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:36.326493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfddc4b-f85d-4344-9f3b-a6233f16d4d3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:36.440652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfddc4b-f85d-4344-9f3b-a6233f16d4d3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:36.477060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec5cf6-36d0-48ae-b0a2-d4b6726e8e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:36.477713 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec5cf6-36d0-48ae-b0a2-d4b6726e8e04 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:36.477997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec5cf6-36d0-48ae-b0a2-d4b6726e8e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:36.478274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ec5cf6-36d0-48ae-b0a2-d4b6726e8e04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:36.516171 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:36.551075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec5cf6-36d0-48ae-b0a2-d4b6726e8e04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:36.552640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ec5cf6-36d0-48ae-b0a2-d4b6726e8e04 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:36.656712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 158/316] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:36.662027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9753-ecce-400f-a929-063148c74e4f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:36.725887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:36.768966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9c9753-ecce-400f-a929-063148c74e4f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:36.809507 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8bdb22-036b-4efc-a9a7-b5a0f5524ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:36.810826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bdb22-036b-4efc-a9a7-b5a0f5524ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:36.811306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bdb22-036b-4efc-a9a7-b5a0f5524ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:36.811742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8bdb22-036b-4efc-a9a7-b5a0f5524ed7 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:36.813118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bdb22-036b-4efc-a9a7-b5a0f5524ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:36.817631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8bdb22-036b-4efc-a9a7-b5a0f5524ed7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:36.817631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 159/317] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:36 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:36.824304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec5cf6-36d0-48ae-b0a2-d4b6726e8e04 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:36.895552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:36.931521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ec5cf6-36d0-48ae-b0a2-d4b6726e8e04 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:36.968128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30414ab-a7e9-4aff-ad60-b078c061eef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:36.968792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30414ab-a7e9-4aff-ad60-b078c061eef9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:36.969075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30414ab-a7e9-4aff-ad60-b078c061eef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:36.969349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30414ab-a7e9-4aff-ad60-b078c061eef9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:36.970186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30414ab-a7e9-4aff-ad60-b078c061eef9 None admin] RBAC: Adding query filter params (role.id=a0dae20055d1456ba8d94cfec7d62668, scope.project.id=18d10b4af4be46f482585d23de6e290d, user.id=dfc5ebbe127b443c970bc0569b9a376a) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:36.970500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30414ab-a7e9-4aff-ad60-b078c061eef9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:36.971961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30414ab-a7e9-4aff-ad60-b078c061eef9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:36.979097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 159/318] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:49:36 2022] GET /identity/v3/role_assignments?user.id=dfc5ebbe127b443c970bc0569b9a376a&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=a0dae20055d1456ba8d94cfec7d62668 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:37.325236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193781d-84d1-4e6b-b391-13abdfefd850 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:37.325592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193781d-84d1-4e6b-b391-13abdfefd850 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:37.325872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b193781d-84d1-4e6b-b391-13abdfefd850 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:37.327383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 160/319] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:37.332344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6404b7c-6d9f-4deb-b8c5-bca9d3f495d8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:37.332635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6404b7c-6d9f-4deb-b8c5-bca9d3f495d8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:37.332913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6404b7c-6d9f-4deb-b8c5-bca9d3f495d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:37.349596 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b6404b7c-6d9f-4deb-b8c5-bca9d3f495d8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:37.350771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b6404b7c-6d9f-4deb-b8c5-bca9d3f495d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:37.419823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 160/320] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:37.442548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193781d-84d1-4e6b-b391-13abdfefd850 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:37.552476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b193781d-84d1-4e6b-b391-13abdfefd850 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:37.578837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:37.586540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3666f-456f-4e88-8bb1-93891e79bc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:37.587344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3666f-456f-4e88-8bb1-93891e79bc2c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:37.587621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3666f-456f-4e88-8bb1-93891e79bc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:37.587895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3666f-456f-4e88-8bb1-93891e79bc2c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:37.592904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3666f-456f-4e88-8bb1-93891e79bc2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:37.592904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3666f-456f-4e88-8bb1-93891e79bc2c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:37.592904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 161/321] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:37.597679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6404b7c-6d9f-4deb-b8c5-bca9d3f495d8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:37.660461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:37.699971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6404b7c-6d9f-4deb-b8c5-bca9d3f495d8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:37.735450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2486-89a5-4878-8448-0fa990e7278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:37.736145 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2486-89a5-4878-8448-0fa990e7278e None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:37.736430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2486-89a5-4878-8448-0fa990e7278e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:37.736706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fca2486-89a5-4878-8448-0fa990e7278e None admin] PATH_INFO: `/v3/groups` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:37.737411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2486-89a5-4878-8448-0fa990e7278e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:37.738849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fca2486-89a5-4878-8448-0fa990e7278e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:37.831617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079e729-480f-4b1b-862b-444f6da976c1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:37.832145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079e729-480f-4b1b-862b-444f6da976c1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:37.832145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a079e729-480f-4b1b-862b-444f6da976c1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:37.833480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 162/322] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:37.838428 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7917df-ab10-448a-a4de-e53d79f212fd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:37.838709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7917df-ab10-448a-a4de-e53d79f212fd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:37.838982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7917df-ab10-448a-a4de-e53d79f212fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:37.850177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 161/323] 10.222.0.85 () {60 vars in 1134 bytes} [Wed Jul 20 21:49:37 2022] POST /identity/v3/groups => generated 226 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:37.859034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-de7917df-ab10-448a-a4de-e53d79f212fd None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:37.860341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-de7917df-ab10-448a-a4de-e53d79f212fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:37.937665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 163/324] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:37.962692 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2486-89a5-4878-8448-0fa990e7278e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:38.069647 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fca2486-89a5-4878-8448-0fa990e7278e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:38.087105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44e5d4-0c4a-4dd6-a4bb-0cc08700b2e2 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:38.087325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44e5d4-0c4a-4dd6-a4bb-0cc08700b2e2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:38.087603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44e5d4-0c4a-4dd6-a4bb-0cc08700b2e2 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:38.089013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 164/325] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:38.095339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ee7eb-7d92-4379-93ad-754ef5bf2c03 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:38.095339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ee7eb-7d92-4379-93ad-754ef5bf2c03 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:38.095573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ee7eb-7d92-4379-93ad-754ef5bf2c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:38.098540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:38.113927 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd05550-d7f0-4d2e-bbae-0c6051c35de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:38.114724 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd05550-d7f0-4d2e-bbae-0c6051c35de3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:38.115070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd05550-d7f0-4d2e-bbae-0c6051c35de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:38.115355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd05550-d7f0-4d2e-bbae-0c6051c35de3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:38.117126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b52ee7eb-7d92-4379-93ad-754ef5bf2c03 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:38.118893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b52ee7eb-7d92-4379-93ad-754ef5bf2c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:38.127838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd05550-d7f0-4d2e-bbae-0c6051c35de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ecd05550-d7f0-4d2e-bbae-0c6051c35de3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:38.136790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:38.138700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:38.139817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 162/326] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:38.145165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd05550-d7f0-4d2e-bbae-0c6051c35de3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:38.209715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 165/327] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:38.233956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ee7eb-7d92-4379-93ad-754ef5bf2c03 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:38.258242 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd05550-d7f0-4d2e-bbae-0c6051c35de3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:38.298449 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97487a63-6c6b-4194-93a1-ef2269246a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:38.299262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97487a63-6c6b-4194-93a1-ef2269246a86 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:38.299671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97487a63-6c6b-4194-93a1-ef2269246a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:38.299979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97487a63-6c6b-4194-93a1-ef2269246a86 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:38.300746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97487a63-6c6b-4194-93a1-ef2269246a86 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:38.301051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97487a63-6c6b-4194-93a1-ef2269246a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:38.303308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97487a63-6c6b-4194-93a1-ef2269246a86 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:38.311246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:38.315950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 163/328] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:38.318829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97487a63-6c6b-4194-93a1-ef2269246a86 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:38.383791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:38.386731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ee7eb-7d92-4379-93ad-754ef5bf2c03 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:38.429558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdc36d-0bea-4354-9dac-f0d85c5e8dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:38.430358 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdc36d-0bea-4354-9dac-f0d85c5e8dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:38.430635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdc36d-0bea-4354-9dac-f0d85c5e8dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:38.430907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbdc36d-0bea-4354-9dac-f0d85c5e8dd7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:38.442692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbdc36d-0bea-4354-9dac-f0d85c5e8dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:38.446831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97487a63-6c6b-4194-93a1-ef2269246a86 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-5fbdc36d-0bea-4354-9dac-f0d85c5e8dd7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:38.454500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:38.455449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:38.456256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 166/329] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:38.463358 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdc36d-0bea-4354-9dac-f0d85c5e8dd7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:38.498289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184fea-261c-4848-a238-b389b3747e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:38.499181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184fea-261c-4848-a238-b389b3747e24 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:38.499463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184fea-261c-4848-a238-b389b3747e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:38.499740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79184fea-261c-4848-a238-b389b3747e24 None admin] PATH_INFO: `/v3/users/fe7eda6e56ae4c0b996f3a0d826fa37b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:38.501168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79184fea-261c-4848-a238-b389b3747e24 None admin] RBAC: Authorizing `identity:get_user(user_id=fe7eda6e56ae4c0b996f3a0d826fa37b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:38.503282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79184fea-261c-4848-a238-b389b3747e24 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:38.506171 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 164/330] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:38 2022] GET /identity/v3/users/fe7eda6e56ae4c0b996f3a0d826fa37b => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:38.511429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184fea-261c-4848-a238-b389b3747e24 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:38.606317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbdc36d-0bea-4354-9dac-f0d85c5e8dd7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:38.628299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:38.649290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79184fea-261c-4848-a238-b389b3747e24 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:38.653376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee32c5-2040-4b1f-8c98-43adf78775a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:38.654318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee32c5-2040-4b1f-8c98-43adf78775a2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:38.654753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee32c5-2040-4b1f-8c98-43adf78775a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:38.655603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ee32c5-2040-4b1f-8c98-43adf78775a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:38.656813 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee32c5-2040-4b1f-8c98-43adf78775a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:38.657284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee32c5-2040-4b1f-8c98-43adf78775a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:38.658575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:38.660367 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ee32c5-2040-4b1f-8c98-43adf78775a2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:38.672501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 167/331] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:38.678621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee32c5-2040-4b1f-8c98-43adf78775a2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:38.689567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a44d65-3143-44fe-b67b-2925215d6704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:38.690247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a44d65-3143-44fe-b67b-2925215d6704 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:38.690522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a44d65-3143-44fe-b67b-2925215d6704 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:38.690833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a44d65-3143-44fe-b67b-2925215d6704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:38.691681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a44d65-3143-44fe-b67b-2925215d6704 None admin] RBAC: Adding query filter params (role.id=36dde009f57f45dd9ded880f26a9b2cc, user.id=fe7eda6e56ae4c0b996f3a0d826fa37b, scope.system=all) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:38.692037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a44d65-3143-44fe-b67b-2925215d6704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:38.693569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a44d65-3143-44fe-b67b-2925215d6704 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:38.714486 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 165/332] 10.222.0.85 () {56 vars in 1308 bytes} [Wed Jul 20 21:49:38 2022] GET /identity/v3/role_assignments?user.id=fe7eda6e56ae4c0b996f3a0d826fa37b&scope.system=all&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:38.812497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ee32c5-2040-4b1f-8c98-43adf78775a2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:38.851433 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b549a3-b4ee-43a5-af77-8362a0a8071b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:38.852427 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b549a3-b4ee-43a5-af77-8362a0a8071b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:38.852713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b549a3-b4ee-43a5-af77-8362a0a8071b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:38.852988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b549a3-b4ee-43a5-af77-8362a0a8071b None admin] PATH_INFO: `/v3/users/85d7f1062f614bd99fa0eaef81828633` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:38.854316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b549a3-b4ee-43a5-af77-8362a0a8071b None admin] RBAC: Authorizing `identity:get_user(user_id=85d7f1062f614bd99fa0eaef81828633)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:38.855784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b549a3-b4ee-43a5-af77-8362a0a8071b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:38.858532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 168/333] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:38 2022] GET /identity/v3/users/85d7f1062f614bd99fa0eaef81828633 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:38.864266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a44d65-3143-44fe-b67b-2925215d6704 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:38.997600 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a44d65-3143-44fe-b67b-2925215d6704 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:39.037163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd187fe-06a2-4ff5-9c4f-4ad746b634ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:39.038024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd187fe-06a2-4ff5-9c4f-4ad746b634ce None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:39.038301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd187fe-06a2-4ff5-9c4f-4ad746b634ce None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:39.038572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd187fe-06a2-4ff5-9c4f-4ad746b634ce None admin] PATH_INFO: `/v3/system/users/85d7f1062f614bd99fa0eaef81828633/roles/a0dae20055d1456ba8d94cfec7d62668` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:39.040113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd187fe-06a2-4ff5-9c4f-4ad746b634ce None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=85d7f1062f614bd99fa0eaef81828633, role_id=a0dae20055d1456ba8d94cfec7d62668)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:39.041485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd187fe-06a2-4ff5-9c4f-4ad746b634ce None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:39.102230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 166/334] 10.222.0.85 () {58 vars in 1334 bytes} [Wed Jul 20 21:49:38 2022] PUT /identity/v3/system/users/85d7f1062f614bd99fa0eaef81828633/roles/a0dae20055d1456ba8d94cfec7d62668 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:40.481517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0637e-ac51-4747-bfc3-040aaba81d44 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:40.482533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0637e-ac51-4747-bfc3-040aaba81d44 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:40.483030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0637e-ac51-4747-bfc3-040aaba81d44 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:40.484948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 169/335] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:40.490552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3900e-8003-40d4-b7e7-320d5686d636 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:40.491407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3900e-8003-40d4-b7e7-320d5686d636 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:40.491896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a3900e-8003-40d4-b7e7-320d5686d636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:40.511111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d1a3900e-8003-40d4-b7e7-320d5686d636 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:40.512992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d1a3900e-8003-40d4-b7e7-320d5686d636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:40.542602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:40.596038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 167/336] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:40.615542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0637e-ac51-4747-bfc3-040aaba81d44 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:40.684139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:40.741190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9712-a1fd-46c3-acbc-69436fd7bc6b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:40.741799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9712-a1fd-46c3-acbc-69436fd7bc6b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:40.742278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a9712-a1fd-46c3-acbc-69436fd7bc6b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:40.748231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 168/337] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:40.749722 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a14bf0-3e95-4c95-803f-860301caac96 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:40.750223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a14bf0-3e95-4c95-803f-860301caac96 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:40.750702 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a14bf0-3e95-4c95-803f-860301caac96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:40.755742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0637e-ac51-4747-bfc3-040aaba81d44 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:40.789026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f7a14bf0-3e95-4c95-803f-860301caac96 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:40.790650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f7a14bf0-3e95-4c95-803f-860301caac96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:40.801689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cefc5c-3e29-468e-aa0f-7d76f87edc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:40.802498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cefc5c-3e29-468e-aa0f-7d76f87edc5d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:40.802796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cefc5c-3e29-468e-aa0f-7d76f87edc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:40.803052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cefc5c-3e29-468e-aa0f-7d76f87edc5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:40.825668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cefc5c-3e29-468e-aa0f-7d76f87edc5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a7cefc5c-3e29-468e-aa0f-7d76f87edc5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:40.834711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:40.835688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:40.836537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:40.841156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 170/338] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:40.846872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cefc5c-3e29-468e-aa0f-7d76f87edc5d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:40.957809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 169/339] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:40.995442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cefc5c-3e29-468e-aa0f-7d76f87edc5d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:40.997068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a14bf0-3e95-4c95-803f-860301caac96 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:41.008288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:41.043274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac93e2-3f8a-4801-a852-db1ce232c51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:41.044108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac93e2-3f8a-4801-a852-db1ce232c51f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:41.044555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac93e2-3f8a-4801-a852-db1ce232c51f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:41.045024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac93e2-3f8a-4801-a852-db1ce232c51f None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:41.045884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac93e2-3f8a-4801-a852-db1ce232c51f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:41.046300 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac93e2-3f8a-4801-a852-db1ce232c51f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:41.048299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac93e2-3f8a-4801-a852-db1ce232c51f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:41.057494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 171/340] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:41.063351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac93e2-3f8a-4801-a852-db1ce232c51f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:41.147355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:41.157858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a14bf0-3e95-4c95-803f-860301caac96 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:41.199177 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac93e2-3f8a-4801-a852-db1ce232c51f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:41.218179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde69564-8e58-4adf-ad5a-b767c03da6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:41.219262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde69564-8e58-4adf-ad5a-b767c03da6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:41.219675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde69564-8e58-4adf-ad5a-b767c03da6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:41.220177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde69564-8e58-4adf-ad5a-b767c03da6b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:41.241865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde69564-8e58-4adf-ad5a-b767c03da6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:41.254549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4be6e4-54d7-42bf-82da-2e9abe8e9c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:41.255588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4be6e4-54d7-42bf-82da-2e9abe8e9c43 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:41.256049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4be6e4-54d7-42bf-82da-2e9abe8e9c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fde69564-8e58-4adf-ad5a-b767c03da6b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:41.256230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:41.257259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:41.258213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 170/341] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:41.259343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4be6e4-54d7-42bf-82da-2e9abe8e9c43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:41.264876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde69564-8e58-4adf-ad5a-b767c03da6b2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:41.311670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:41.359945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4be6e4-54d7-42bf-82da-2e9abe8e9c43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:41.359945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4be6e4-54d7-42bf-82da-2e9abe8e9c43 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:41.411569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde69564-8e58-4adf-ad5a-b767c03da6b2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:41.468657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468719-3893-47d9-9292-7d13416f552f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:41.469605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468719-3893-47d9-9292-7d13416f552f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:41.470051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468719-3893-47d9-9292-7d13416f552f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:41.470477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51468719-3893-47d9-9292-7d13416f552f None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:41.471377 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468719-3893-47d9-9292-7d13416f552f None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:41.471834 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468719-3893-47d9-9292-7d13416f552f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:41.473405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51468719-3893-47d9-9292-7d13416f552f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:41.479967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 172/342] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:41.486048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4be6e4-54d7-42bf-82da-2e9abe8e9c43 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:41.488076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 171/343] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:41.489088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468719-3893-47d9-9292-7d13416f552f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:41.542297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:41.568407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:41.603081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4be6e4-54d7-42bf-82da-2e9abe8e9c43 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:41.640279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1d7a9-4fb9-4bd4-a00e-a45255de731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:41.641540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d7a9-4fb9-4bd4-a00e-a45255de731d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:41.641780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d7a9-4fb9-4bd4-a00e-a45255de731d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:41.642146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1d7a9-4fb9-4bd4-a00e-a45255de731d None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:41.643361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1d7a9-4fb9-4bd4-a00e-a45255de731d None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:41.644956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1d7a9-4fb9-4bd4-a00e-a45255de731d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:41.651804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 173/344] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:41 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:41.653380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e15e-5844-4ed2-bda0-4accd7db7613 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:41.653770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e15e-5844-4ed2-bda0-4accd7db7613 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:41.654050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa9e15e-5844-4ed2-bda0-4accd7db7613 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:41.659669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 174/345] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:41.660467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e15e-5844-4ed2-bda0-4accd7db7613 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:41.696865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51468719-3893-47d9-9292-7d13416f552f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:41.764778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d197436-c278-4719-8adc-1e12719a2804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:41.765709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197436-c278-4719-8adc-1e12719a2804 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:41.765995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197436-c278-4719-8adc-1e12719a2804 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:41.766271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d197436-c278-4719-8adc-1e12719a2804 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:41.785124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa9e15e-5844-4ed2-bda0-4accd7db7613 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:41.823760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec4c1a0-2d33-44c8-ad04-aefb3fbaf33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:41.824587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c1a0-2d33-44c8-ad04-aefb3fbaf33c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:41.825086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c1a0-2d33-44c8-ad04-aefb3fbaf33c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:41.825660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec4c1a0-2d33-44c8-ad04-aefb3fbaf33c None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:41.833094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4c1a0-2d33-44c8-ad04-aefb3fbaf33c None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:41.834553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec4c1a0-2d33-44c8-ad04-aefb3fbaf33c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:41.837446 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 175/346] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:41 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:41.844021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f3e79-8b22-428f-9e3c-3719008be00b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:41.844305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f3e79-8b22-428f-9e3c-3719008be00b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:41.844580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f3e79-8b22-428f-9e3c-3719008be00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:41.846644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:41.865163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b54f3e79-8b22-428f-9e3c-3719008be00b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:41.866363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b54f3e79-8b22-428f-9e3c-3719008be00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:41.887830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d197436-c278-4719-8adc-1e12719a2804 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:41.889865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d197436-c278-4719-8adc-1e12719a2804 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:41.922050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:41.941983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 176/347] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:41.948982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f3e79-8b22-428f-9e3c-3719008be00b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:42.059044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f3e79-8b22-428f-9e3c-3719008be00b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:42.072328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 172/348] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:42.073275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d197436-c278-4719-8adc-1e12719a2804 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:42.092385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:42.100788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7270ec-c31a-4476-a767-40929d4a05f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:42.101820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7270ec-c31a-4476-a767-40929d4a05f4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:42.102245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7270ec-c31a-4476-a767-40929d4a05f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:42.102661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7270ec-c31a-4476-a767-40929d4a05f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:42.103652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7270ec-c31a-4476-a767-40929d4a05f4 None admin] RBAC: Adding query filter params (group.id=dce74a38cafd4e48b593f62d135e2849, role.id=5b16ed690a6942c288df268569b6ab85, scope.project.id=37a366467c364c32b052631d9f1b6e63) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:42.104150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7270ec-c31a-4476-a767-40929d4a05f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:42.105735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7270ec-c31a-4476-a767-40929d4a05f4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:42.112520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 177/349] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Jul 20 21:49:41 2022] GET /identity/v3/role_assignments?group.id=dce74a38cafd4e48b593f62d135e2849&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=5b16ed690a6942c288df268569b6ab85 => generated 260 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:42.114600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7270ec-c31a-4476-a767-40929d4a05f4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:42.227731 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d197436-c278-4719-8adc-1e12719a2804 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:42.255391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:42.290027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7270ec-c31a-4476-a767-40929d4a05f4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:42.293469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ec6f4-0c92-4159-a9fa-bdff3f7dc15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:42.293646 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ec6f4-0c92-4159-a9fa-bdff3f7dc15c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:42.294090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ec6f4-0c92-4159-a9fa-bdff3f7dc15c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:42.294591 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81ec6f4-0c92-4159-a9fa-bdff3f7dc15c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:42.314616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81ec6f4-0c92-4159-a9fa-bdff3f7dc15c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e81ec6f4-0c92-4159-a9fa-bdff3f7dc15c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:42.328236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:42.329223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:42.330693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 173/350] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:42.341381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ec6f4-0c92-4159-a9fa-bdff3f7dc15c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:42.377337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9fb7-fb64-4e5d-8164-2f38e98b1419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:42.378153 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9fb7-fb64-4e5d-8164-2f38e98b1419 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:42.378429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9fb7-fb64-4e5d-8164-2f38e98b1419 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:42.378701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9fb7-fb64-4e5d-8164-2f38e98b1419 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:42.379966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f9fb7-fb64-4e5d-8164-2f38e98b1419 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:42.381432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f9fb7-fb64-4e5d-8164-2f38e98b1419 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:42.383283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 178/351] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:42 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:42.402426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9fb7-fb64-4e5d-8164-2f38e98b1419 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:42.510796 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81ec6f4-0c92-4159-a9fa-bdff3f7dc15c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:42.558865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5685d07-e956-40d7-af02-d29c09041b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:42.560367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685d07-e956-40d7-af02-d29c09041b74 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:42.560822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685d07-e956-40d7-af02-d29c09041b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:42.561107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5685d07-e956-40d7-af02-d29c09041b74 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:42.561885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685d07-e956-40d7-af02-d29c09041b74 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:42.562195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685d07-e956-40d7-af02-d29c09041b74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:42.563598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5685d07-e956-40d7-af02-d29c09041b74 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:42.566804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:42.589969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 174/352] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:42.594265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0409-64b4-4ca4-a8dc-315d33e51b27 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:42.594612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0409-64b4-4ca4-a8dc-315d33e51b27 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:42.595126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c0409-64b4-4ca4-a8dc-315d33e51b27 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:42.596706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 175/353] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:42.597275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c0409-64b4-4ca4-a8dc-315d33e51b27 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:42.652716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9fb7-fb64-4e5d-8164-2f38e98b1419 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:42.681558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:42.720334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f031d730-002f-4f42-9fb0-33957656afe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:42.721205 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d730-002f-4f42-9fb0-33957656afe9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:42.721484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d730-002f-4f42-9fb0-33957656afe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:42.721761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f031d730-002f-4f42-9fb0-33957656afe9 None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:42.722958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031d730-002f-4f42-9fb0-33957656afe9 None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:42.724438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f031d730-002f-4f42-9fb0-33957656afe9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:42.726377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 179/354] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:42 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:42.727557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b9550-27b5-4fb4-a24e-18de6e31c277 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:42.727909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b9550-27b5-4fb4-a24e-18de6e31c277 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:42.728162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b9550-27b5-4fb4-a24e-18de6e31c277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:42.752467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-561b9550-27b5-4fb4-a24e-18de6e31c277 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:42.753663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-561b9550-27b5-4fb4-a24e-18de6e31c277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:42.770622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c0409-64b4-4ca4-a8dc-315d33e51b27 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:42.823421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9e9da-8263-4387-9d54-c8bce9a6fd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:42.824469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9e9da-8263-4387-9d54-c8bce9a6fd0d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:42.824739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9e9da-8263-4387-9d54-c8bce9a6fd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:42.825015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a9e9da-8263-4387-9d54-c8bce9a6fd0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:42.854483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 180/355] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:42.857047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb1231-1f35-41fa-a2f0-dfdac8c74e52 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:42.857330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb1231-1f35-41fa-a2f0-dfdac8c74e52 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:42.857598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb1231-1f35-41fa-a2f0-dfdac8c74e52 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:42.859685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 181/356] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:42.861971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb1231-1f35-41fa-a2f0-dfdac8c74e52 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:42.932538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9e9da-8263-4387-9d54-c8bce9a6fd0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:42.934023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a9e9da-8263-4387-9d54-c8bce9a6fd0d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:42.943051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:42.996818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:43.009767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb1231-1f35-41fa-a2f0-dfdac8c74e52 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:43.047874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7092aa3-b8c9-481d-b23f-5d314a436bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:43.048559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7092aa3-b8c9-481d-b23f-5d314a436bc2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.048838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7092aa3-b8c9-481d-b23f-5d314a436bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.049112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7092aa3-b8c9-481d-b23f-5d314a436bc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.049955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7092aa3-b8c9-481d-b23f-5d314a436bc2 None admin] RBAC: Adding query filter params (group.id=dce74a38cafd4e48b593f62d135e2849, role.id=36dde009f57f45dd9ded880f26a9b2cc, scope.project.id=37a366467c364c32b052631d9f1b6e63) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:43.050262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7092aa3-b8c9-481d-b23f-5d314a436bc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:43.051740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7092aa3-b8c9-481d-b23f-5d314a436bc2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:43.061681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 182/357] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Jul 20 21:49:42 2022] GET /identity/v3/role_assignments?group.id=dce74a38cafd4e48b593f62d135e2849&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:43.062931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49e6d-ff6a-46a4-9e59-d7b78be57e32 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.063220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49e6d-ff6a-46a4-9e59-d7b78be57e32 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.063497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df49e6d-ff6a-46a4-9e59-d7b78be57e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.083235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 176/358] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:43.084556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9e9da-8263-4387-9d54-c8bce9a6fd0d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:43.084866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9df49e6d-ff6a-46a4-9e59-d7b78be57e32 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:43.087060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9df49e6d-ff6a-46a4-9e59-d7b78be57e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:43.199948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 183/359] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:43.204930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc75ae-d000-4fd2-84c9-c728cb019482 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.204930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc75ae-d000-4fd2-84c9-c728cb019482 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.204930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dc75ae-d000-4fd2-84c9-c728cb019482 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.206406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 184/360] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:43.207230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc75ae-d000-4fd2-84c9-c728cb019482 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:43.222688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a9e9da-8263-4387-9d54-c8bce9a6fd0d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:43.264611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca4d5a-5778-4742-ac46-7c1ce5376d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:43.266212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca4d5a-5778-4742-ac46-7c1ce5376d84 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.266708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca4d5a-5778-4742-ac46-7c1ce5376d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.267346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca4d5a-5778-4742-ac46-7c1ce5376d84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.277318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:43.283327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca4d5a-5778-4742-ac46-7c1ce5376d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:43.286143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d1ca4d5a-5778-4742-ac46-7c1ce5376d84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:43.293956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:43.295050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 20 21:49:43.295953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:43.298493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 177/361] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:43.300062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfd216-13c9-48e9-aade-89a663c2f44f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.300497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfd216-13c9-48e9-aade-89a663c2f44f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.300898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfd216-13c9-48e9-aade-89a663c2f44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.326967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e1dfd216-13c9-48e9-aade-89a663c2f44f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:43.330167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e1dfd216-13c9-48e9-aade-89a663c2f44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:43.352716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dc75ae-d000-4fd2-84c9-c728cb019482 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:43.397445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402df89-de27-4c5c-b136-20fa53addac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:43.398473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402df89-de27-4c5c-b136-20fa53addac5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.398600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402df89-de27-4c5c-b136-20fa53addac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.398871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c402df89-de27-4c5c-b136-20fa53addac5 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.402385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402df89-de27-4c5c-b136-20fa53addac5 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:43.404745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c402df89-de27-4c5c-b136-20fa53addac5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:43.406875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 185/362] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:43 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:43.407689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402df89-de27-4c5c-b136-20fa53addac5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:43.409015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 178/363] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:43.410251 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfd216-13c9-48e9-aade-89a663c2f44f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:43.524947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfd216-13c9-48e9-aade-89a663c2f44f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:43.541800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c402df89-de27-4c5c-b136-20fa53addac5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:43.558368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:43.567332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389cea8-ec8d-4760-9782-59cdfedc330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:43.568803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389cea8-ec8d-4760-9782-59cdfedc330b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.569301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389cea8-ec8d-4760-9782-59cdfedc330b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.569925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4389cea8-ec8d-4760-9782-59cdfedc330b None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.576127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389cea8-ec8d-4760-9782-59cdfedc330b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:43.576127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389cea8-ec8d-4760-9782-59cdfedc330b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:43.576320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:43.576706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4389cea8-ec8d-4760-9782-59cdfedc330b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:43.584302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 179/364] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:43.584630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd4a1b-c7d3-4d4b-94be-64c5b828ee23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:43.585363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd4a1b-c7d3-4d4b-94be-64c5b828ee23 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.585680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd4a1b-c7d3-4d4b-94be-64c5b828ee23 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.586104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389cea8-ec8d-4760-9782-59cdfedc330b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:43.586214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dd4a1b-c7d3-4d4b-94be-64c5b828ee23 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.608988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dd4a1b-c7d3-4d4b-94be-64c5b828ee23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-71dd4a1b-c7d3-4d4b-94be-64c5b828ee23 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:43.617479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:43.618465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:43.619721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 186/365] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:43.620696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd4a1b-c7d3-4d4b-94be-64c5b828ee23 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:43.707022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4389cea8-ec8d-4760-9782-59cdfedc330b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:43.750443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dd4a1b-c7d3-4d4b-94be-64c5b828ee23 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:43.754924 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7e7e0-f210-4869-b747-ba26f801dcc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:43.756109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7e7e0-f210-4869-b747-ba26f801dcc0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.756613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7e7e0-f210-4869-b747-ba26f801dcc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.757086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed7e7e0-f210-4869-b747-ba26f801dcc0 None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.758883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7e7e0-f210-4869-b747-ba26f801dcc0 None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:43.760789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed7e7e0-f210-4869-b747-ba26f801dcc0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:43.763804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 180/366] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:43 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:43.764887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7e7e0-f210-4869-b747-ba26f801dcc0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:43.820125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614003c9-26a9-49dd-be89-10cf90adce97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:43.820865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614003c9-26a9-49dd-be89-10cf90adce97 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.821145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614003c9-26a9-49dd-be89-10cf90adce97 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.821414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614003c9-26a9-49dd-be89-10cf90adce97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.832887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:43.841097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614003c9-26a9-49dd-be89-10cf90adce97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-614003c9-26a9-49dd-be89-10cf90adce97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:43.851196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:43.852408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:43.853310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:43.856104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 187/367] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:49:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:43.857277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614003c9-26a9-49dd-be89-10cf90adce97 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:43.890275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed7e7e0-f210-4869-b747-ba26f801dcc0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:43.921065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:43.964279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd73617-d378-4a37-b3da-60dd6671dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:43.965346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd73617-d378-4a37-b3da-60dd6671dd0b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:43.965836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd73617-d378-4a37-b3da-60dd6671dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:43.966286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd73617-d378-4a37-b3da-60dd6671dd0b None admin] PATH_INFO: `/v3/users/85d7f1062f614bd99fa0eaef81828633` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:43.968803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd73617-d378-4a37-b3da-60dd6671dd0b None admin] RBAC: Authorizing `identity:get_user(user_id=85d7f1062f614bd99fa0eaef81828633)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:43.970522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd73617-d378-4a37-b3da-60dd6671dd0b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:43.972879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 181/368] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:49:43 2022] GET /identity/v3/users/85d7f1062f614bd99fa0eaef81828633 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:43.974099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd73617-d378-4a37-b3da-60dd6671dd0b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:44.007457 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614003c9-26a9-49dd-be89-10cf90adce97 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:44.050552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170ff06-58b5-4400-b155-17c72bac61f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:44.051107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170ff06-58b5-4400-b155-17c72bac61f0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:44.051447 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170ff06-58b5-4400-b155-17c72bac61f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:44.051676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6170ff06-58b5-4400-b155-17c72bac61f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:44.052462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170ff06-58b5-4400-b155-17c72bac61f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:44.052766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170ff06-58b5-4400-b155-17c72bac61f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:44.054150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6170ff06-58b5-4400-b155-17c72bac61f0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:44.065547 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 188/369] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:44.066395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170ff06-58b5-4400-b155-17c72bac61f0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:44.092974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd73617-d378-4a37-b3da-60dd6671dd0b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:44.127866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:44.139748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5f849-937f-4949-b220-4cebc6e8a8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:44.140992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5f849-937f-4949-b220-4cebc6e8a8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:44.141410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5f849-937f-4949-b220-4cebc6e8a8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:44.141914 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5f849-937f-4949-b220-4cebc6e8a8e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:44.143128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5f849-937f-4949-b220-4cebc6e8a8e1 None admin] RBAC: Adding query filter params (group.id=dce74a38cafd4e48b593f62d135e2849, role.id=36dde009f57f45dd9ded880f26a9b2cc, scope.project.id=18d10b4af4be46f482585d23de6e290d) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:44.143612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5f849-937f-4949-b220-4cebc6e8a8e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:44.145470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5f849-937f-4949-b220-4cebc6e8a8e1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:44.152633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 182/370] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Jul 20 21:49:43 2022] GET /identity/v3/role_assignments?group.id=dce74a38cafd4e48b593f62d135e2849&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:44.153991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5f849-937f-4949-b220-4cebc6e8a8e1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:44.196798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6170ff06-58b5-4400-b155-17c72bac61f0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:44.199523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:44.237323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5ac54-81cf-4a19-a13a-a09ab021733a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:44.238589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5ac54-81cf-4a19-a13a-a09ab021733a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:44.239253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5ac54-81cf-4a19-a13a-a09ab021733a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:44.240097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a5ac54-81cf-4a19-a13a-a09ab021733a None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:44.240863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5ac54-81cf-4a19-a13a-a09ab021733a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:44.241173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5ac54-81cf-4a19-a13a-a09ab021733a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:44.242599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a5ac54-81cf-4a19-a13a-a09ab021733a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:44.253202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 189/371] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:44.254105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5ac54-81cf-4a19-a13a-a09ab021733a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:44.348963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5f849-937f-4949-b220-4cebc6e8a8e1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:44.371161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a5ac54-81cf-4a19-a13a-a09ab021733a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:44.407440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3a6b0-439e-41df-9972-728cb931ab27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:44.408663 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3a6b0-439e-41df-9972-728cb931ab27 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:44.409225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3a6b0-439e-41df-9972-728cb931ab27 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:44.409859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b3a6b0-439e-41df-9972-728cb931ab27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:44.410924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cd375-257a-418d-9da7-e927a431aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:44.411207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3a6b0-439e-41df-9972-728cb931ab27 None admin] RBAC: Adding query filter params (role.id=a0dae20055d1456ba8d94cfec7d62668, user.id=85d7f1062f614bd99fa0eaef81828633, scope.system=all) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:44.411581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cd375-257a-418d-9da7-e927a431aa19 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:44.411867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cd375-257a-418d-9da7-e927a431aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:44.412132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3a6b0-439e-41df-9972-728cb931ab27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:44.412228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84cd375-257a-418d-9da7-e927a431aa19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:44.413983 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b3a6b0-439e-41df-9972-728cb931ab27 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:44.438168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 183/372] 10.222.0.85 () {56 vars in 1308 bytes} [Wed Jul 20 21:49:44 2022] GET /identity/v3/role_assignments?user.id=85d7f1062f614bd99fa0eaef81828633&scope.system=all&role.id=a0dae20055d1456ba8d94cfec7d62668 => generated 510 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:44.439519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3a6b0-439e-41df-9972-728cb931ab27 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:44.457984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:44.499079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cd375-257a-418d-9da7-e927a431aa19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:44.500646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84cd375-257a-418d-9da7-e927a431aa19 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:44.530899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:44.621568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 190/373] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:44.630826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cd375-257a-418d-9da7-e927a431aa19 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:44.631279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b3a6b0-439e-41df-9972-728cb931ab27 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:44.690141 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cc3f3-29d5-4d7f-abe2-f02482d4eda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:44.690806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cc3f3-29d5-4d7f-abe2-f02482d4eda1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:44.691088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cc3f3-29d5-4d7f-abe2-f02482d4eda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:44.691363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23cc3f3-29d5-4d7f-abe2-f02482d4eda1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:44.713011 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:44.746395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84cd375-257a-418d-9da7-e927a431aa19 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:44.791968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770b4fc-16b6-439b-b397-ae34ec30b2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:44.792919 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770b4fc-16b6-439b-b397-ae34ec30b2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:44.793354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770b4fc-16b6-439b-b397-ae34ec30b2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:44.793669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770b4fc-16b6-439b-b397-ae34ec30b2e5 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:44.795009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770b4fc-16b6-439b-b397-ae34ec30b2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:44.796533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770b4fc-16b6-439b-b397-ae34ec30b2e5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:44.798578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 191/374] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:44 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:44.804346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770b4fc-16b6-439b-b397-ae34ec30b2e5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:44.825976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cc3f3-29d5-4d7f-abe2-f02482d4eda1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:44.827545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23cc3f3-29d5-4d7f-abe2-f02482d4eda1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:44.918063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770b4fc-16b6-439b-b397-ae34ec30b2e5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:44.922905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:44.961731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4161-e989-452a-8f87-36b39f88750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:44.961731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4161-e989-452a-8f87-36b39f88750e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:44.961731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4161-e989-452a-8f87-36b39f88750e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:44.961731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f4161-e989-452a-8f87-36b39f88750e None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:44.963017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f4161-e989-452a-8f87-36b39f88750e None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:44.967300 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f4161-e989-452a-8f87-36b39f88750e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:44.967300 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 192/375] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:44 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:44.977260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4161-e989-452a-8f87-36b39f88750e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:44.985254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:45.029795 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 184/376] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:45.035614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cc3f3-29d5-4d7f-abe2-f02482d4eda1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:45.160689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f4161-e989-452a-8f87-36b39f88750e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:45.195571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23cc3f3-29d5-4d7f-abe2-f02482d4eda1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:45.206723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8720a-2f53-4f3c-a35d-b1d5d044c822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:45.207412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8720a-2f53-4f3c-a35d-b1d5d044c822 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:45.207698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8720a-2f53-4f3c-a35d-b1d5d044c822 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:45.208000 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8720a-2f53-4f3c-a35d-b1d5d044c822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:45.209533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8720a-2f53-4f3c-a35d-b1d5d044c822 None admin] RBAC: Adding query filter params (group.id=dce74a38cafd4e48b593f62d135e2849, role.id=5b16ed690a6942c288df268569b6ab85, scope.project.id=18d10b4af4be46f482585d23de6e290d) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:45.209851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8720a-2f53-4f3c-a35d-b1d5d044c822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:45.211759 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8720a-2f53-4f3c-a35d-b1d5d044c822 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:45.221848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 193/377] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Jul 20 21:49:44 2022] GET /identity/v3/role_assignments?group.id=dce74a38cafd4e48b593f62d135e2849&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=5b16ed690a6942c288df268569b6ab85 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:45.222719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec22cd-6647-413f-9b6a-d04d9f024870 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:45.223012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec22cd-6647-413f-9b6a-d04d9f024870 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:45.223294 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfec22cd-6647-413f-9b6a-d04d9f024870 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:45.225731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 194/378] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:45.233705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca94241-97d9-4b95-a59d-0d23d5470247 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:45.234058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca94241-97d9-4b95-a59d-0d23d5470247 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:45.234266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca94241-97d9-4b95-a59d-0d23d5470247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:45.248910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876569b-f20c-4ecf-9ec7-99654fad553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:45.249857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876569b-f20c-4ecf-9ec7-99654fad553f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:45.250200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876569b-f20c-4ecf-9ec7-99654fad553f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:45.250537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876569b-f20c-4ecf-9ec7-99654fad553f None admin] PATH_INFO: `/v3/projects/e58c029bf3c74b4692bf7afb2155976a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:45.251795 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876569b-f20c-4ecf-9ec7-99654fad553f None admin] RBAC: Authorizing `identity:get_project(project_id=e58c029bf3c74b4692bf7afb2155976a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:45.253844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4876569b-f20c-4ecf-9ec7-99654fad553f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:45.255775 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-aca94241-97d9-4b95-a59d-0d23d5470247 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:45.257173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aca94241-97d9-4b95-a59d-0d23d5470247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:45.260229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 185/379] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:45 2022] GET /identity/v3/projects/e58c029bf3c74b4692bf7afb2155976a => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:45.261839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876569b-f20c-4ecf-9ec7-99654fad553f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:45.285738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:45.345329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:45.355813 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 195/380] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:45.381268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca94241-97d9-4b95-a59d-0d23d5470247 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:45.405795 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876569b-f20c-4ecf-9ec7-99654fad553f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:45.447560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7f382-8896-4413-a6a9-35c8158601ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:45.447560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7f382-8896-4413-a6a9-35c8158601ee None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:45.447822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7f382-8896-4413-a6a9-35c8158601ee None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:45.448002 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7f382-8896-4413-a6a9-35c8158601ee None admin] PATH_INFO: `/v3/groups/227e539ea22342da87fc7a40e5462206` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:45.459420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7f382-8896-4413-a6a9-35c8158601ee None admin] RBAC: Authorizing `identity:get_group(group_id=227e539ea22342da87fc7a40e5462206)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:45.461819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7f382-8896-4413-a6a9-35c8158601ee None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:45.465797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 186/381] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:45 2022] GET /identity/v3/groups/227e539ea22342da87fc7a40e5462206 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:45.471751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7f382-8896-4413-a6a9-35c8158601ee None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:45.576211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:45.577846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca94241-97d9-4b95-a59d-0d23d5470247 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:45.601263 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7f382-8896-4413-a6a9-35c8158601ee None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:45.627772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14db67c-a026-4ff3-8635-329bb0ba5646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:45.629319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14db67c-a026-4ff3-8635-329bb0ba5646 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:45.629831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14db67c-a026-4ff3-8635-329bb0ba5646 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:45.630305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14db67c-a026-4ff3-8635-329bb0ba5646 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:45.643756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14db67c-a026-4ff3-8635-329bb0ba5646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:45.645140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6ef86-3a4c-4c77-aaaf-7e61ab8cb3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:45.645992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6ef86-3a4c-4c77-aaaf-7e61ab8cb3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:45.646272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6ef86-3a4c-4c77-aaaf-7e61ab8cb3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:45.646547 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d6ef86-3a4c-4c77-aaaf-7e61ab8cb3b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:45.647566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6ef86-3a4c-4c77-aaaf-7e61ab8cb3b0 None admin] RBAC: Adding query filter params (group.id=227e539ea22342da87fc7a40e5462206, role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=e58c029bf3c74b4692bf7afb2155976a) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:45.647881 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6ef86-3a4c-4c77-aaaf-7e61ab8cb3b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:45.649406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d6ef86-3a4c-4c77-aaaf-7e61ab8cb3b0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c14db67c-a026-4ff3-8635-329bb0ba5646 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:45.655726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:45.657326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:45.658136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:45.660041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 187/382] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Jul 20 21:49:45 2022] GET /identity/v3/role_assignments?group.id=227e539ea22342da87fc7a40e5462206&scope.project.id=e58c029bf3c74b4692bf7afb2155976a&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:45.661097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 196/383] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:45.667448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6ef86-3a4c-4c77-aaaf-7e61ab8cb3b0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:45.785213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d6ef86-3a4c-4c77-aaaf-7e61ab8cb3b0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:45.787990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f455540-44a6-4256-b85e-b5f54b7349c9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:45.788600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f455540-44a6-4256-b85e-b5f54b7349c9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:45.789098 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f455540-44a6-4256-b85e-b5f54b7349c9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:45.790895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 197/384] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:45.797452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad3c2c-42cd-4a89-91ce-fe1990cbe2fe None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:45.797808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad3c2c-42cd-4a89-91ce-fe1990cbe2fe None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:45.798190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad3c2c-42cd-4a89-91ce-fe1990cbe2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:45.822816 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a7ad3c2c-42cd-4a89-91ce-fe1990cbe2fe None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:45.825200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a7ad3c2c-42cd-4a89-91ce-fe1990cbe2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:45.831463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cf1e4-d634-4eef-8584-b9a37cfb06c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:45.832201 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cf1e4-d634-4eef-8584-b9a37cfb06c4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:45.832485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cf1e4-d634-4eef-8584-b9a37cfb06c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:45.832764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cf1e4-d634-4eef-8584-b9a37cfb06c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:45.833551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cf1e4-d634-4eef-8584-b9a37cfb06c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:45.833866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cf1e4-d634-4eef-8584-b9a37cfb06c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:45.835364 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cf1e4-d634-4eef-8584-b9a37cfb06c4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:45.848238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 188/385] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:45.855158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cf1e4-d634-4eef-8584-b9a37cfb06c4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:45.868191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:45.916955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:45.953103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 198/386] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:45.988237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad3c2c-42cd-4a89-91ce-fe1990cbe2fe None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:46.050225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cf1e4-d634-4eef-8584-b9a37cfb06c4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:46.115744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd04db-5b28-4308-8306-aee3e012518f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:46.116734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd04db-5b28-4308-8306-aee3e012518f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:46.117010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd04db-5b28-4308-8306-aee3e012518f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:46.117289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd04db-5b28-4308-8306-aee3e012518f None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:46.118576 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd04db-5b28-4308-8306-aee3e012518f None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:46.120165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd04db-5b28-4308-8306-aee3e012518f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:46.125506 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad3c2c-42cd-4a89-91ce-fe1990cbe2fe None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:46.130052 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 189/387] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:45 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:46.131004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd04db-5b28-4308-8306-aee3e012518f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:46.212639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605795b-8da6-4806-8bcc-aa6556e34c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:46.213804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605795b-8da6-4806-8bcc-aa6556e34c33 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:46.214280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605795b-8da6-4806-8bcc-aa6556e34c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:46.214785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605795b-8da6-4806-8bcc-aa6556e34c33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:46.226481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:46.240916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b605795b-8da6-4806-8bcc-aa6556e34c33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b605795b-8da6-4806-8bcc-aa6556e34c33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:46.255951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:46.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:46.257703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:46.258829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd04db-5b28-4308-8306-aee3e012518f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:46.260809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 199/388] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:46.266990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605795b-8da6-4806-8bcc-aa6556e34c33 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:46.303815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f838c-0aa8-4e1b-aadb-f66c75455867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:46.304646 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f838c-0aa8-4e1b-aadb-f66c75455867 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:46.304923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f838c-0aa8-4e1b-aadb-f66c75455867 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:46.305195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f838c-0aa8-4e1b-aadb-f66c75455867 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:46.306409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f838c-0aa8-4e1b-aadb-f66c75455867 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:46.307869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f838c-0aa8-4e1b-aadb-f66c75455867 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:46.310600 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 190/389] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:46 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:46.316478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f838c-0aa8-4e1b-aadb-f66c75455867 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:46.365524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:46.464829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605795b-8da6-4806-8bcc-aa6556e34c33 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:46.501573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f838c-0aa8-4e1b-aadb-f66c75455867 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:46.537732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73894f-98d2-4e0c-a0fd-f916b58bb0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:46.538406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73894f-98d2-4e0c-a0fd-f916b58bb0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:46.538682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73894f-98d2-4e0c-a0fd-f916b58bb0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:46.538954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73894f-98d2-4e0c-a0fd-f916b58bb0a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:46.539708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73894f-98d2-4e0c-a0fd-f916b58bb0a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:46.540033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73894f-98d2-4e0c-a0fd-f916b58bb0a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:46.541424 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73894f-98d2-4e0c-a0fd-f916b58bb0a3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:46.554609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 200/390] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:46.561880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73894f-98d2-4e0c-a0fd-f916b58bb0a3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:46.577984 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d971c-1a9c-4e40-ad52-d0e7f008e766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:46.578927 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d971c-1a9c-4e40-ad52-d0e7f008e766 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:46.579196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d971c-1a9c-4e40-ad52-d0e7f008e766 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:46.579468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796d971c-1a9c-4e40-ad52-d0e7f008e766 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63/groups/dce74a38cafd4e48b593f62d135e2849/roles/5b16ed690a6942c288df268569b6ab85` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:46.583907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d971c-1a9c-4e40-ad52-d0e7f008e766 None admin] RBAC: Authorizing `identity:create_grant(project_id=37a366467c364c32b052631d9f1b6e63, group_id=dce74a38cafd4e48b593f62d135e2849, role_id=5b16ed690a6942c288df268569b6ab85)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:46.585378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796d971c-1a9c-4e40-ad52-d0e7f008e766 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:46.692733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 191/391] 10.222.0.85 () {58 vars in 1442 bytes} [Wed Jul 20 21:49:46 2022] PUT /identity/v3/projects/37a366467c364c32b052631d9f1b6e63/groups/dce74a38cafd4e48b593f62d135e2849/roles/5b16ed690a6942c288df268569b6ab85 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:46.720426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73894f-98d2-4e0c-a0fd-f916b58bb0a3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:46.733172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:46.764348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3391-3e37-449a-95a7-35ff789b4978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:46.765268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3391-3e37-449a-95a7-35ff789b4978 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:46.765807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3391-3e37-449a-95a7-35ff789b4978 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:46.766155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b3391-3e37-449a-95a7-35ff789b4978 None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:46.768951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b3391-3e37-449a-95a7-35ff789b4978 None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:46.770529 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b3391-3e37-449a-95a7-35ff789b4978 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:46.772819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 201/392] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:46 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:46.779250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d971c-1a9c-4e40-ad52-d0e7f008e766 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:46.782265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:46.916993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796d971c-1a9c-4e40-ad52-d0e7f008e766 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:46.972196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cc98ab-7e24-4c5f-ab6b-14ad96d7e657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:46.973085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc98ab-7e24-4c5f-ab6b-14ad96d7e657 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:46.973368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc98ab-7e24-4c5f-ab6b-14ad96d7e657 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:46.973645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cc98ab-7e24-4c5f-ab6b-14ad96d7e657 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:46.974918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc98ab-7e24-4c5f-ab6b-14ad96d7e657 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:46.976458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cc98ab-7e24-4c5f-ab6b-14ad96d7e657 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:46.978407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 192/393] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:46 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:46.984735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3391-3e37-449a-95a7-35ff789b4978 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:47.103232 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b3391-3e37-449a-95a7-35ff789b4978 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:47.138296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a1fb0-63ca-4f8e-90fc-81096a03e468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:47.139256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1fb0-63ca-4f8e-90fc-81096a03e468 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:47.139539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1fb0-63ca-4f8e-90fc-81096a03e468 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:47.139815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a1fb0-63ca-4f8e-90fc-81096a03e468 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63/groups/dce74a38cafd4e48b593f62d135e2849/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:47.142270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a1fb0-63ca-4f8e-90fc-81096a03e468 None admin] RBAC: Authorizing `identity:create_grant(project_id=37a366467c364c32b052631d9f1b6e63, group_id=dce74a38cafd4e48b593f62d135e2849, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:47.143716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a1fb0-63ca-4f8e-90fc-81096a03e468 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:47.227754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 202/394] 10.222.0.85 () {58 vars in 1442 bytes} [Wed Jul 20 21:49:46 2022] PUT /identity/v3/projects/37a366467c364c32b052631d9f1b6e63/groups/dce74a38cafd4e48b593f62d135e2849/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:47.399322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a419-66f6-426a-a38c-ea4a899818b2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:47.399638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a419-66f6-426a-a38c-ea4a899818b2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:47.399882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58a419-66f6-426a-a38c-ea4a899818b2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:47.401434 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 193/395] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:47.408293 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542bd99-5d79-4a6f-a28f-b2ae8304c775 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:47.408599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542bd99-5d79-4a6f-a28f-b2ae8304c775 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:47.408851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542bd99-5d79-4a6f-a28f-b2ae8304c775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:47.437284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1542bd99-5d79-4a6f-a28f-b2ae8304c775 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:47.438513 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1542bd99-5d79-4a6f-a28f-b2ae8304c775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:47.477706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:47.529360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 203/396] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:47.557131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a419-66f6-426a-a38c-ea4a899818b2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:47.668074 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:47.706343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58a419-66f6-426a-a38c-ea4a899818b2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:47.755346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80d0a-b2de-4a12-8bdb-1f4efd2b5428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:47.756169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80d0a-b2de-4a12-8bdb-1f4efd2b5428 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:47.756447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80d0a-b2de-4a12-8bdb-1f4efd2b5428 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:47.756715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b80d0a-b2de-4a12-8bdb-1f4efd2b5428 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:47.769095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b80d0a-b2de-4a12-8bdb-1f4efd2b5428 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e2b80d0a-b2de-4a12-8bdb-1f4efd2b5428 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:47.780613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:47.781493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:47.782401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 194/397] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:47.788460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542bd99-5d79-4a6f-a28f-b2ae8304c775 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:47.917742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542bd99-5d79-4a6f-a28f-b2ae8304c775 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:47.955392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b86967-b101-4b9f-9969-93af7d598ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:47.956089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b86967-b101-4b9f-9969-93af7d598ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:47.956367 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b86967-b101-4b9f-9969-93af7d598ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:47.956644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b86967-b101-4b9f-9969-93af7d598ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:47.957393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b86967-b101-4b9f-9969-93af7d598ca7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:47.957694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b86967-b101-4b9f-9969-93af7d598ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:47.959082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b86967-b101-4b9f-9969-93af7d598ca7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:47.969556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 204/398] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:47.975368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80d0a-b2de-4a12-8bdb-1f4efd2b5428 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:48.118116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b80d0a-b2de-4a12-8bdb-1f4efd2b5428 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:48.154514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:48.160642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4bd5c-fd16-4d12-be4e-7e276c1b50c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:48.161441 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4bd5c-fd16-4d12-be4e-7e276c1b50c1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:48.161732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4bd5c-fd16-4d12-be4e-7e276c1b50c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:48.162251 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4bd5c-fd16-4d12-be4e-7e276c1b50c1 None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:48.163450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4bd5c-fd16-4d12-be4e-7e276c1b50c1 None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:48.164908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4bd5c-fd16-4d12-be4e-7e276c1b50c1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:48.166899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 195/399] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:47 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:48.172556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b86967-b101-4b9f-9969-93af7d598ca7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:48.213184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:48.304722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b86967-b101-4b9f-9969-93af7d598ca7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:48.342415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b467926b-84f1-420b-9f19-a7741e55f56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:48.343286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467926b-84f1-420b-9f19-a7741e55f56d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:48.343563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467926b-84f1-420b-9f19-a7741e55f56d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:48.343832 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b467926b-84f1-420b-9f19-a7741e55f56d None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:48.345085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467926b-84f1-420b-9f19-a7741e55f56d None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:48.346523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b467926b-84f1-420b-9f19-a7741e55f56d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:48.348548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 205/400] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:48 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:48.354092 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4bd5c-fd16-4d12-be4e-7e276c1b50c1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:48.384616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5d2ea-2117-4ad3-a342-3561c9774e9d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:48.384815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5d2ea-2117-4ad3-a342-3561c9774e9d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:48.385388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca5d2ea-2117-4ad3-a342-3561c9774e9d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:48.388502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 206/401] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:48.398641 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ac77-d538-4b5e-b614-e2028bb6e976 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:48.398919 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ac77-d538-4b5e-b614-e2028bb6e976 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:48.399194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11ac77-d538-4b5e-b614-e2028bb6e976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:48.421375 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-db11ac77-d538-4b5e-b614-e2028bb6e976 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:48.422572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-db11ac77-d538-4b5e-b614-e2028bb6e976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:48.521224 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 207/402] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:48.545872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11ac77-d538-4b5e-b614-e2028bb6e976 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:48.584412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:48.585662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4bd5c-fd16-4d12-be4e-7e276c1b50c1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:48.638063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18310f2a-b458-490e-a694-4ae9f8e7a2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:48.639176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18310f2a-b458-490e-a694-4ae9f8e7a2b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:48.639616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18310f2a-b458-490e-a694-4ae9f8e7a2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:48.640198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18310f2a-b458-490e-a694-4ae9f8e7a2b3 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d/groups/dce74a38cafd4e48b593f62d135e2849/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:48.642628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18310f2a-b458-490e-a694-4ae9f8e7a2b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=18d10b4af4be46f482585d23de6e290d, group_id=dce74a38cafd4e48b593f62d135e2849, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:48.644439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18310f2a-b458-490e-a694-4ae9f8e7a2b3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:48.686362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11ac77-d538-4b5e-b614-e2028bb6e976 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:48.724019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d12841-bff3-4004-b0e4-19d4ffa80439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:48.724803 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d12841-bff3-4004-b0e4-19d4ffa80439 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:48.725087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d12841-bff3-4004-b0e4-19d4ffa80439 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:48.725359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d12841-bff3-4004-b0e4-19d4ffa80439 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:48.738790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d12841-bff3-4004-b0e4-19d4ffa80439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:48.748296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 196/403] 10.222.0.85 () {58 vars in 1442 bytes} [Wed Jul 20 21:49:48 2022] PUT /identity/v3/projects/18d10b4af4be46f482585d23de6e290d/groups/dce74a38cafd4e48b593f62d135e2849/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:48.749710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09c33f-98bc-4515-9d72-ba15ab676402 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:48.749989 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09c33f-98bc-4515-9d72-ba15ab676402 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:48.750261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09c33f-98bc-4515-9d72-ba15ab676402 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:48.752011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 197/404] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d7d12841-bff3-4004-b0e4-19d4ffa80439 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:48.754616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:48.755520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:48.756420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:48.758007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1a270-ab94-418f-9958-f3255bff0e8a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:48.758384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1a270-ab94-418f-9958-f3255bff0e8a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:48.758750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1a270-ab94-418f-9958-f3255bff0e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:48.759499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 208/405] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:48.766730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d12841-bff3-4004-b0e4-19d4ffa80439 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:48.785970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-14e1a270-ab94-418f-9958-f3255bff0e8a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:48.787328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-14e1a270-ab94-418f-9958-f3255bff0e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:48.857349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:48.874763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 198/406] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:48.885911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:48.903778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d12841-bff3-4004-b0e4-19d4ffa80439 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:48.905782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1a270-ab94-418f-9958-f3255bff0e8a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:48.950721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b8668-8caa-4d5f-adae-eaa14f2de9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:48.951861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b8668-8caa-4d5f-adae-eaa14f2de9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:48.953017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b8668-8caa-4d5f-adae-eaa14f2de9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:48.953465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52b8668-8caa-4d5f-adae-eaa14f2de9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:48.954863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b8668-8caa-4d5f-adae-eaa14f2de9b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:48.955339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b8668-8caa-4d5f-adae-eaa14f2de9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:48.957255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52b8668-8caa-4d5f-adae-eaa14f2de9b4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:48.968890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 209/407] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:48.980390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b8668-8caa-4d5f-adae-eaa14f2de9b4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:49.081904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1a270-ab94-418f-9958-f3255bff0e8a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:49.123743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704725c-72b4-4cc5-a861-69cd9ab7f0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:49.124572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704725c-72b4-4cc5-a861-69cd9ab7f0fa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.125313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704725c-72b4-4cc5-a861-69cd9ab7f0fa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.125587 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704725c-72b4-4cc5-a861-69cd9ab7f0fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.138325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4704725c-72b4-4cc5-a861-69cd9ab7f0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4704725c-72b4-4cc5-a861-69cd9ab7f0fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:49.147163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:49.148101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:49.148873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:49.149661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 199/408] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:49:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:49.154838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704725c-72b4-4cc5-a861-69cd9ab7f0fa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:49.170622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52b8668-8caa-4d5f-adae-eaa14f2de9b4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:49.212393 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:49.252163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39f69c-87ef-4d53-96db-630187646709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:49.253382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39f69c-87ef-4d53-96db-630187646709 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.253881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39f69c-87ef-4d53-96db-630187646709 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.254341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a39f69c-87ef-4d53-96db-630187646709 None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.255719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39f69c-87ef-4d53-96db-630187646709 None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:49.265955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a39f69c-87ef-4d53-96db-630187646709 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:49.268280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 210/409] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:48 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:49.280051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704725c-72b4-4cc5-a861-69cd9ab7f0fa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:49.285300 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39f69c-87ef-4d53-96db-630187646709 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:49.320239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cca817-a57f-40ca-8cb2-e9eb743ead38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:49.320962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cca817-a57f-40ca-8cb2-e9eb743ead38 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.321241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cca817-a57f-40ca-8cb2-e9eb743ead38 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.321513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cca817-a57f-40ca-8cb2-e9eb743ead38 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.325359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cca817-a57f-40ca-8cb2-e9eb743ead38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:49.325359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cca817-a57f-40ca-8cb2-e9eb743ead38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:49.325359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cca817-a57f-40ca-8cb2-e9eb743ead38 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:49.327635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:49.336628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 200/410] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:49.343771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cca817-a57f-40ca-8cb2-e9eb743ead38 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:49.463207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cca817-a57f-40ca-8cb2-e9eb743ead38 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:49.488318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:49.505298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4294b-1f8b-40c7-b939-c85ba2a7a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:49.506383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4294b-1f8b-40c7-b939-c85ba2a7a021 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.508310 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4294b-1f8b-40c7-b939-c85ba2a7a021 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.508727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab4294b-1f8b-40c7-b939-c85ba2a7a021 None admin] PATH_INFO: `/v3/groups/227e539ea22342da87fc7a40e5462206` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.510289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4294b-1f8b-40c7-b939-c85ba2a7a021 None admin] RBAC: Authorizing `identity:get_group(group_id=227e539ea22342da87fc7a40e5462206)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:49.514074 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab4294b-1f8b-40c7-b939-c85ba2a7a021 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:49.516330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 201/411] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:49 2022] GET /identity/v3/groups/227e539ea22342da87fc7a40e5462206 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:49.521882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a39f69c-87ef-4d53-96db-630187646709 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:49.523058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4294b-1f8b-40c7-b939-c85ba2a7a021 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:49.598108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6396e-fcf8-46c9-adfc-aff78e17bc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:49.599726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6396e-fcf8-46c9-adfc-aff78e17bc7c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.600196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6396e-fcf8-46c9-adfc-aff78e17bc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.600626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e6396e-fcf8-46c9-adfc-aff78e17bc7c None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.602002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6396e-fcf8-46c9-adfc-aff78e17bc7c None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:49.603578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e6396e-fcf8-46c9-adfc-aff78e17bc7c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:49.606893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 211/412] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:49 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:49.613147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6396e-fcf8-46c9-adfc-aff78e17bc7c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:49.671450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab4294b-1f8b-40c7-b939-c85ba2a7a021 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:49.708684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081a126-a2d7-4f66-b024-fe6def32d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:49.709955 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081a126-a2d7-4f66-b024-fe6def32d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.710430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081a126-a2d7-4f66-b024-fe6def32d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.710891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081a126-a2d7-4f66-b024-fe6def32d7c8 None admin] PATH_INFO: `/v3/projects/e58c029bf3c74b4692bf7afb2155976a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.712347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081a126-a2d7-4f66-b024-fe6def32d7c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e58c029bf3c74b4692bf7afb2155976a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:49.714080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081a126-a2d7-4f66-b024-fe6def32d7c8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:49.716696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 202/413] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:49 2022] GET /identity/v3/projects/e58c029bf3c74b4692bf7afb2155976a => generated 344 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:49.721910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081a126-a2d7-4f66-b024-fe6def32d7c8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:49.792248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:49.802006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:49.812596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e6396e-fcf8-46c9-adfc-aff78e17bc7c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:49.852163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d6571a-0cf8-4cb6-a2b7-3a1ab3451f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:49.853059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6571a-0cf8-4cb6-a2b7-3a1ab3451f85 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.853336 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6571a-0cf8-4cb6-a2b7-3a1ab3451f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.853609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d6571a-0cf8-4cb6-a2b7-3a1ab3451f85 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d/groups/dce74a38cafd4e48b593f62d135e2849/roles/5b16ed690a6942c288df268569b6ab85` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.856204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6571a-0cf8-4cb6-a2b7-3a1ab3451f85 None admin] RBAC: Authorizing `identity:create_grant(project_id=18d10b4af4be46f482585d23de6e290d, group_id=dce74a38cafd4e48b593f62d135e2849, role_id=5b16ed690a6942c288df268569b6ab85)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:49.857755 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d6571a-0cf8-4cb6-a2b7-3a1ab3451f85 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:49.867550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081a126-a2d7-4f66-b024-fe6def32d7c8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:49.904167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd85fae-5837-46cc-b485-ea6e39de73ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:49.905042 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd85fae-5837-46cc-b485-ea6e39de73ec None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.905318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd85fae-5837-46cc-b485-ea6e39de73ec None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.905588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd85fae-5837-46cc-b485-ea6e39de73ec None admin] PATH_INFO: `/v3/projects/e58c029bf3c74b4692bf7afb2155976a/groups/227e539ea22342da87fc7a40e5462206/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.907501 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd85fae-5837-46cc-b485-ea6e39de73ec None admin] RBAC: Authorizing `identity:create_grant(project_id=e58c029bf3c74b4692bf7afb2155976a, group_id=227e539ea22342da87fc7a40e5462206, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:49.908961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd85fae-5837-46cc-b485-ea6e39de73ec None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:49.935903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 212/414] 10.222.0.85 () {58 vars in 1442 bytes} [Wed Jul 20 21:49:49 2022] PUT /identity/v3/projects/18d10b4af4be46f482585d23de6e290d/groups/dce74a38cafd4e48b593f62d135e2849/roles/5b16ed690a6942c288df268569b6ab85 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:49.937815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8451f-6d93-454a-a283-0f3d5264ba4b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.938108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8451f-6d93-454a-a283-0f3d5264ba4b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.938389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c8451f-6d93-454a-a283-0f3d5264ba4b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.939863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 213/415] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:49.940881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9467605-3498-41da-8979-9c95fc16f605 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.941180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9467605-3498-41da-8979-9c95fc16f605 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.941449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9467605-3498-41da-8979-9c95fc16f605 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.952730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 214/416] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:49.952730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30437e44-8b9d-413b-965f-7972efa2638a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.952730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30437e44-8b9d-413b-965f-7972efa2638a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.952730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30437e44-8b9d-413b-965f-7972efa2638a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:49.969736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-30437e44-8b9d-413b-965f-7972efa2638a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:49.969736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-30437e44-8b9d-413b-965f-7972efa2638a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:49.990694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 203/417] 10.222.0.85 () {58 vars in 1442 bytes} [Wed Jul 20 21:49:49 2022] PUT /identity/v3/projects/e58c029bf3c74b4692bf7afb2155976a/groups/227e539ea22342da87fc7a40e5462206/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:49:49.992589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5905283-eaab-49a6-970b-56a44cd8b0ec None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:49.993118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5905283-eaab-49a6-970b-56a44cd8b0ec None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:49.993654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5905283-eaab-49a6-970b-56a44cd8b0ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:50.025520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a5905283-eaab-49a6-970b-56a44cd8b0ec None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:50.029848 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a5905283-eaab-49a6-970b-56a44cd8b0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:50.134186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 215/418] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:50.139438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 204/419] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:50.160406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30437e44-8b9d-413b-965f-7972efa2638a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:50.165648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5905283-eaab-49a6-970b-56a44cd8b0ec None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:50.218474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:50.252099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:50.276743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30437e44-8b9d-413b-965f-7972efa2638a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:50.320782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5905283-eaab-49a6-970b-56a44cd8b0ec None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:50.322880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b24ff8-0b2a-40df-bcc1-fd992e0940eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:50.323695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b24ff8-0b2a-40df-bcc1-fd992e0940eb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:50.324019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b24ff8-0b2a-40df-bcc1-fd992e0940eb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:50.324346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b24ff8-0b2a-40df-bcc1-fd992e0940eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:50.351788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b24ff8-0b2a-40df-bcc1-fd992e0940eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-62b24ff8-0b2a-40df-bcc1-fd992e0940eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:50.361660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:50.362566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:50.364183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 216/420] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:50.373288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b24ff8-0b2a-40df-bcc1-fd992e0940eb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:50.391615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e99e70-956f-48d9-b0ef-ec93be232ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:50.392452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e99e70-956f-48d9-b0ef-ec93be232ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:50.392730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e99e70-956f-48d9-b0ef-ec93be232ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:50.392999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e99e70-956f-48d9-b0ef-ec93be232ba3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:50.417718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e99e70-956f-48d9-b0ef-ec93be232ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a8e99e70-956f-48d9-b0ef-ec93be232ba3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:50.426151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:50.427232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:50.428485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 205/421] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:50.440836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e99e70-956f-48d9-b0ef-ec93be232ba3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:50.551770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b24ff8-0b2a-40df-bcc1-fd992e0940eb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:50.580675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:50.590572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e99e70-956f-48d9-b0ef-ec93be232ba3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:50.592807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d83c3-c579-4b2a-946a-48867952ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:50.593723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d83c3-c579-4b2a-946a-48867952ed11 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:50.594214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d83c3-c579-4b2a-946a-48867952ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:50.594698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d83c3-c579-4b2a-946a-48867952ed11 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:50.595640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d83c3-c579-4b2a-946a-48867952ed11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:50.596174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d83c3-c579-4b2a-946a-48867952ed11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:50.597793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d83c3-c579-4b2a-946a-48867952ed11 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:50.599653 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:50.612542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 217/422] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:50.618063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d83c3-c579-4b2a-946a-48867952ed11 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:50.674304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947da84c-a79b-4019-9651-9b2bef02674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:50.677088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947da84c-a79b-4019-9651-9b2bef02674e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:50.677675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947da84c-a79b-4019-9651-9b2bef02674e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:50.678931 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947da84c-a79b-4019-9651-9b2bef02674e None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:50.680034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947da84c-a79b-4019-9651-9b2bef02674e None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:50.681853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947da84c-a79b-4019-9651-9b2bef02674e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:50.684437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947da84c-a79b-4019-9651-9b2bef02674e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:50.703296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 206/423] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:50.710098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947da84c-a79b-4019-9651-9b2bef02674e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:50.782112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d83c3-c579-4b2a-946a-48867952ed11 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:50.823647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72a62b-0fc6-4bdf-9678-5988e730a4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:50.825373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72a62b-0fc6-4bdf-9678-5988e730a4ee None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:50.825873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72a62b-0fc6-4bdf-9678-5988e730a4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:50.826336 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72a62b-0fc6-4bdf-9678-5988e730a4ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:50.896236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:50.905020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72a62b-0fc6-4bdf-9678-5988e730a4ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:50.906728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72a62b-0fc6-4bdf-9678-5988e730a4ee None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:50.917644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947da84c-a79b-4019-9651-9b2bef02674e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:51.000635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05bcf1-655c-4204-94c8-af7275566086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:51.003360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05bcf1-655c-4204-94c8-af7275566086 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:51.003836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05bcf1-655c-4204-94c8-af7275566086 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:51.005422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd05bcf1-655c-4204-94c8-af7275566086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:51.024201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 218/424] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:51.030295 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72a62b-0fc6-4bdf-9678-5988e730a4ee None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:51.069940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:51.144192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05bcf1-655c-4204-94c8-af7275566086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:51.144358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd05bcf1-655c-4204-94c8-af7275566086 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:51.185357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:51.195028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72a62b-0fc6-4bdf-9678-5988e730a4ee None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:51.275952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aac02-c203-4092-b59b-f5a63590c1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:51.276852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aac02-c203-4092-b59b-f5a63590c1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:51.277133 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aac02-c203-4092-b59b-f5a63590c1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:51.277558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7aac02-c203-4092-b59b-f5a63590c1e0 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:51.279071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7aac02-c203-4092-b59b-f5a63590c1e0 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:51.280586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7aac02-c203-4092-b59b-f5a63590c1e0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:51.282767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 219/425] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:51 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:51.288455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aac02-c203-4092-b59b-f5a63590c1e0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:51.289115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 207/426] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:51.295099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05bcf1-655c-4204-94c8-af7275566086 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:51.365143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:51.402830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd05bcf1-655c-4204-94c8-af7275566086 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:51.443276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e1c7b-f471-4473-aaef-f28d54776368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:51.444173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1c7b-f471-4473-aaef-f28d54776368 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:51.444451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1c7b-f471-4473-aaef-f28d54776368 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:51.444978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1c7b-f471-4473-aaef-f28d54776368 None admin] PATH_INFO: `/v3/projects/37a366467c364c32b052631d9f1b6e63` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:51.446734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e1c7b-f471-4473-aaef-f28d54776368 None admin] RBAC: Authorizing `identity:get_project(project_id=37a366467c364c32b052631d9f1b6e63)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:51.448483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e1c7b-f471-4473-aaef-f28d54776368 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:51.452522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 208/427] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:51 2022] GET /identity/v3/projects/37a366467c364c32b052631d9f1b6e63 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:51.453734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693c867-81dd-4323-bb5b-6ae709fdd991 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:51.454015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693c867-81dd-4323-bb5b-6ae709fdd991 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:51.454284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0693c867-81dd-4323-bb5b-6ae709fdd991 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:51.455717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 209/428] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:51.457869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693c867-81dd-4323-bb5b-6ae709fdd991 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:51.492453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7aac02-c203-4092-b59b-f5a63590c1e0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:51.537935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3898fa9e-b476-4057-ad9e-372ed31668e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:51.538892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898fa9e-b476-4057-ad9e-372ed31668e1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:51.539489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898fa9e-b476-4057-ad9e-372ed31668e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:51.539836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3898fa9e-b476-4057-ad9e-372ed31668e1 None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:51.541694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898fa9e-b476-4057-ad9e-372ed31668e1 None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:51.544438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3898fa9e-b476-4057-ad9e-372ed31668e1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:51.546081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 220/429] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:51 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:51.547211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85696266-32d7-4664-a77d-78f1966bef2c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:51.547490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85696266-32d7-4664-a77d-78f1966bef2c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:51.547762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85696266-32d7-4664-a77d-78f1966bef2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:51.569290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-85696266-32d7-4664-a77d-78f1966bef2c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:51.570386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-85696266-32d7-4664-a77d-78f1966bef2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:51.583902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0693c867-81dd-4323-bb5b-6ae709fdd991 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:51.596528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:51.615277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:51.627170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a647562-7094-40f7-baa7-fd3352297a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:51.628368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a647562-7094-40f7-baa7-fd3352297a48 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:51.628903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a647562-7094-40f7-baa7-fd3352297a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:51.629383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a647562-7094-40f7-baa7-fd3352297a48 None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:51.630840 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a647562-7094-40f7-baa7-fd3352297a48 None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:51.632652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a647562-7094-40f7-baa7-fd3352297a48 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:51.639947 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 221/431] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:51.640239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 210/431] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:51 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:51.641057 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85696266-32d7-4664-a77d-78f1966bef2c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:51.641862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a647562-7094-40f7-baa7-fd3352297a48 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:51.745196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85696266-32d7-4664-a77d-78f1966bef2c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:51.753103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a647562-7094-40f7-baa7-fd3352297a48 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:51.781223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e43c8-7012-4d30-8379-7422f7f362fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:51.781882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e43c8-7012-4d30-8379-7422f7f362fe None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:51.782159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e43c8-7012-4d30-8379-7422f7f362fe None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:51.782429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e43c8-7012-4d30-8379-7422f7f362fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:51.783261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e43c8-7012-4d30-8379-7422f7f362fe None admin] RBAC: Adding query filter params (group.id=dce74a38cafd4e48b593f62d135e2849, role.id=5b16ed690a6942c288df268569b6ab85, scope.project.id=37a366467c364c32b052631d9f1b6e63) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:51.783572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e43c8-7012-4d30-8379-7422f7f362fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:51.785041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e43c8-7012-4d30-8379-7422f7f362fe None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:51.791800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675db93-dfbf-4a31-adb4-57337fbe3a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:51.797808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675db93-dfbf-4a31-adb4-57337fbe3a49 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:51.797808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675db93-dfbf-4a31-adb4-57337fbe3a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:51.797808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7675db93-dfbf-4a31-adb4-57337fbe3a49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:51.797808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675db93-dfbf-4a31-adb4-57337fbe3a49 None admin] RBAC: Adding query filter params (group.id=dce74a38cafd4e48b593f62d135e2849, role.id=36dde009f57f45dd9ded880f26a9b2cc, scope.project.id=37a366467c364c32b052631d9f1b6e63) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:51.797808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675db93-dfbf-4a31-adb4-57337fbe3a49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:51.797808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7675db93-dfbf-4a31-adb4-57337fbe3a49 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:51.798292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 222/432] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Jul 20 21:49:51 2022] GET /identity/v3/role_assignments?group.id=dce74a38cafd4e48b593f62d135e2849&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=5b16ed690a6942c288df268569b6ab85 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:51.798875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e43c8-7012-4d30-8379-7422f7f362fe None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:51.805246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 211/433] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Jul 20 21:49:51 2022] GET /identity/v3/role_assignments?group.id=dce74a38cafd4e48b593f62d135e2849&scope.project.id=37a366467c364c32b052631d9f1b6e63&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:51.843575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:51.959564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e43c8-7012-4d30-8379-7422f7f362fe None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:52.014056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5663-92c9-4ef9-bef3-dfeef6bd73bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:52.014783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5663-92c9-4ef9-bef3-dfeef6bd73bf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.015061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5663-92c9-4ef9-bef3-dfeef6bd73bf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.015579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da5663-92c9-4ef9-bef3-dfeef6bd73bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.028763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da5663-92c9-4ef9-bef3-dfeef6bd73bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-75da5663-92c9-4ef9-bef3-dfeef6bd73bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:52.036719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:52.037710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:52.038500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 223/434] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:52.045828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675db93-dfbf-4a31-adb4-57337fbe3a49 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:52.126563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:52.174517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7675db93-dfbf-4a31-adb4-57337fbe3a49 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:52.218465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb067d6-b57e-41fc-be73-8499bc8ce6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:52.219472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb067d6-b57e-41fc-be73-8499bc8ce6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.220044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb067d6-b57e-41fc-be73-8499bc8ce6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.220513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb067d6-b57e-41fc-be73-8499bc8ce6f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.221469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb067d6-b57e-41fc-be73-8499bc8ce6f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:52.221969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb067d6-b57e-41fc-be73-8499bc8ce6f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:52.223540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb067d6-b57e-41fc-be73-8499bc8ce6f2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:52.234044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 212/435] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:49:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:52.239556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5663-92c9-4ef9-bef3-dfeef6bd73bf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:52.304100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b5a7f-272a-41cf-bea2-a8b7843d5064 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.304448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b5a7f-272a-41cf-bea2-a8b7843d5064 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.304822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5b5a7f-272a-41cf-bea2-a8b7843d5064 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.306523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 213/436] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:52.313977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e231a-67a1-4ddf-b6ac-3fa4e7184c77 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.314473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e231a-67a1-4ddf-b6ac-3fa4e7184c77 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.314887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e231a-67a1-4ddf-b6ac-3fa4e7184c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.337036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:52.337218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-404e231a-67a1-4ddf-b6ac-3fa4e7184c77 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:52.338279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-404e231a-67a1-4ddf-b6ac-3fa4e7184c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:52.354228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da5663-92c9-4ef9-bef3-dfeef6bd73bf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:52.391232 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0846fa1-3cd2-4d2f-bbe0-6751db2a0d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:52.392146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0846fa1-3cd2-4d2f-bbe0-6751db2a0d24 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.392566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0846fa1-3cd2-4d2f-bbe0-6751db2a0d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.393005 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0846fa1-3cd2-4d2f-bbe0-6751db2a0d24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.421348 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 214/437] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:52.422352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433689d1-ee3b-4a27-a40f-985e4d642613 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.422642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433689d1-ee3b-4a27-a40f-985e4d642613 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.423263 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433689d1-ee3b-4a27-a40f-985e4d642613 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.424746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 215/438] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:52.429867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6afd8-bf85-4249-b0f4-183b90358cf6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.430156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6afd8-bf85-4249-b0f4-183b90358cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.430436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a6afd8-bf85-4249-b0f4-183b90358cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.449073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-15a6afd8-bf85-4249-b0f4-183b90358cf6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:52.451211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-15a6afd8-bf85-4249-b0f4-183b90358cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:52.478018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0846fa1-3cd2-4d2f-bbe0-6751db2a0d24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:52.479655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0846fa1-3cd2-4d2f-bbe0-6751db2a0d24 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:52.507429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:52.533228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 216/439] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:52.534080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6afd8-bf85-4249-b0f4-183b90358cf6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:52.586533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:52.605638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 224/440] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 21:49:52.606752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0846fa1-3cd2-4d2f-bbe0-6751db2a0d24 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:52.658181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a6afd8-bf85-4249-b0f4-183b90358cf6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:52.693273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5e98d-7771-43e8-bfac-c80f4814ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:52.694066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5e98d-7771-43e8-bfac-c80f4814ff16 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.694347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5e98d-7771-43e8-bfac-c80f4814ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.694620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5e98d-7771-43e8-bfac-c80f4814ff16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.705457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5e98d-7771-43e8-bfac-c80f4814ff16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:52.711120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0846fa1-3cd2-4d2f-bbe0-6751db2a0d24 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a0b5e98d-7771-43e8-bfac-c80f4814ff16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:52.713471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:52.714551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 217/441] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:52.715443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5e98d-7771-43e8-bfac-c80f4814ff16 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:52.744717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d66d-83ed-4b09-88f9-239461ce4ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:52.745504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d66d-83ed-4b09-88f9-239461ce4ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.745784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d66d-83ed-4b09-88f9-239461ce4ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.746684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c671d66d-83ed-4b09-88f9-239461ce4ea2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.756600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c671d66d-83ed-4b09-88f9-239461ce4ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:52.760744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c671d66d-83ed-4b09-88f9-239461ce4ea2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:52.764939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:52.766118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:52.766896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 225/442] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:49:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:52.767534 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d66d-83ed-4b09-88f9-239461ce4ea2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:52.813630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:52.820528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5e98d-7771-43e8-bfac-c80f4814ff16 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:52.854864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f53465-bdc4-4211-8509-14641a764d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:52.855742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f53465-bdc4-4211-8509-14641a764d96 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.856055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f53465-bdc4-4211-8509-14641a764d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.856328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f53465-bdc4-4211-8509-14641a764d96 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.857536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f53465-bdc4-4211-8509-14641a764d96 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:52.859033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f53465-bdc4-4211-8509-14641a764d96 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:52.860942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 218/443] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:52 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:52.861539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f53465-bdc4-4211-8509-14641a764d96 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:52.867218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c671d66d-83ed-4b09-88f9-239461ce4ea2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:52.903182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc034f-c316-49d1-b962-c01fc4f86a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:52.903847 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc034f-c316-49d1-b962-c01fc4f86a56 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:52.904164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc034f-c316-49d1-b962-c01fc4f86a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:52.904440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc034f-c316-49d1-b962-c01fc4f86a56 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:52.905181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc034f-c316-49d1-b962-c01fc4f86a56 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:52.905489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc034f-c316-49d1-b962-c01fc4f86a56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:52.906870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc034f-c316-49d1-b962-c01fc4f86a56 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:52.915092 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 226/444] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:52.915655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc034f-c316-49d1-b962-c01fc4f86a56 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:52.968404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f53465-bdc4-4211-8509-14641a764d96 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:52.977319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:53.005057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bb7f7-1925-4322-b41c-2cfc01092d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.005742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb7f7-1925-4322-b41c-2cfc01092d6b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.006023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb7f7-1925-4322-b41c-2cfc01092d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.006301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bb7f7-1925-4322-b41c-2cfc01092d6b None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.007076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bb7f7-1925-4322-b41c-2cfc01092d6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:53.007388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bb7f7-1925-4322-b41c-2cfc01092d6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.008842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bb7f7-1925-4322-b41c-2cfc01092d6b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.018039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 219/445] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:53.018878 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bb7f7-1925-4322-b41c-2cfc01092d6b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:53.025202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc034f-c316-49d1-b962-c01fc4f86a56 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:53.034856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:53.060325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e29a2a-33dc-46f1-9291-143db4ffc9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.061173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e29a2a-33dc-46f1-9291-143db4ffc9cf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.061458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e29a2a-33dc-46f1-9291-143db4ffc9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.061726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e29a2a-33dc-46f1-9291-143db4ffc9cf None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.062963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e29a2a-33dc-46f1-9291-143db4ffc9cf None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.064427 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e29a2a-33dc-46f1-9291-143db4ffc9cf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.066548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 227/446] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:52 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:53.067727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e29a2a-33dc-46f1-9291-143db4ffc9cf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:53.119003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bb7f7-1925-4322-b41c-2cfc01092d6b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:53.153857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4c61-ff62-4b06-9342-d81de5fa3c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.154499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4c61-ff62-4b06-9342-d81de5fa3c21 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.154782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4c61-ff62-4b06-9342-d81de5fa3c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.155057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf4c61-ff62-4b06-9342-d81de5fa3c21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.168685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e29a2a-33dc-46f1-9291-143db4ffc9cf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:53.194369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:53.202114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c94e5-8fa0-4f30-adb6-60dfa330331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.202780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c94e5-8fa0-4f30-adb6-60dfa330331f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.203061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c94e5-8fa0-4f30-adb6-60dfa330331f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.203334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03c94e5-8fa0-4f30-adb6-60dfa330331f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.222670 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf4c61-ff62-4b06-9342-d81de5fa3c21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.224181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf4c61-ff62-4b06-9342-d81de5fa3c21 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.247953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:53.270724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c94e5-8fa0-4f30-adb6-60dfa330331f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.272243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03c94e5-8fa0-4f30-adb6-60dfa330331f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.325996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 220/447] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:53.327333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4c61-ff62-4b06-9342-d81de5fa3c21 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:53.371700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 228/448] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:49:53.372563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c94e5-8fa0-4f30-adb6-60dfa330331f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:53.400611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:53.431549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf4c61-ff62-4b06-9342-d81de5fa3c21 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:53.450502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:53.466475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dda44-9280-48ad-89c5-adcb1c480a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.467125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dda44-9280-48ad-89c5-adcb1c480a88 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.467415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dda44-9280-48ad-89c5-adcb1c480a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.467690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6dda44-9280-48ad-89c5-adcb1c480a88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.468634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dda44-9280-48ad-89c5-adcb1c480a88 None admin] RBAC: Adding query filter params (group.id=dce74a38cafd4e48b593f62d135e2849, role.id=36dde009f57f45dd9ded880f26a9b2cc, scope.project.id=18d10b4af4be46f482585d23de6e290d) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:53.468946 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dda44-9280-48ad-89c5-adcb1c480a88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.470382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6dda44-9280-48ad-89c5-adcb1c480a88 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.473404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03c94e5-8fa0-4f30-adb6-60dfa330331f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:53.476284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 221/449] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Jul 20 21:49:53 2022] GET /identity/v3/role_assignments?group.id=dce74a38cafd4e48b593f62d135e2849&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=36dde009f57f45dd9ded880f26a9b2cc => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:53.477080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dda44-9280-48ad-89c5-adcb1c480a88 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:53.513152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f3e6f-9ef0-4ad9-b895-e2f98bc28aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.514314 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f3e6f-9ef0-4ad9-b895-e2f98bc28aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.514587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f3e6f-9ef0-4ad9-b895-e2f98bc28aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.514862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f3e6f-9ef0-4ad9-b895-e2f98bc28aa4 None admin] PATH_INFO: `/v3/projects/18d10b4af4be46f482585d23de6e290d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.516433 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f3e6f-9ef0-4ad9-b895-e2f98bc28aa4 None admin] RBAC: Authorizing `identity:get_project(project_id=18d10b4af4be46f482585d23de6e290d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.517887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f3e6f-9ef0-4ad9-b895-e2f98bc28aa4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.519805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 229/450] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:53 2022] GET /identity/v3/projects/18d10b4af4be46f482585d23de6e290d => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:53.525349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f3e6f-9ef0-4ad9-b895-e2f98bc28aa4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:53.604784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6dda44-9280-48ad-89c5-adcb1c480a88 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:53.644938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaaf0d-94f7-4b29-a52c-7d3691839aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.645737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaaf0d-94f7-4b29-a52c-7d3691839aef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.646014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaaf0d-94f7-4b29-a52c-7d3691839aef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.646308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbaaf0d-94f7-4b29-a52c-7d3691839aef None admin] PATH_INFO: `/v3/projects/e58c029bf3c74b4692bf7afb2155976a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.646750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f3e6f-9ef0-4ad9-b895-e2f98bc28aa4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:53.648462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaaf0d-94f7-4b29-a52c-7d3691839aef None admin] RBAC: Authorizing `identity:get_project(project_id=e58c029bf3c74b4692bf7afb2155976a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.649968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbaaf0d-94f7-4b29-a52c-7d3691839aef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.653876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 222/451] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:49:53 2022] GET /identity/v3/projects/e58c029bf3c74b4692bf7afb2155976a => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:53.658052 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaaf0d-94f7-4b29-a52c-7d3691839aef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:53.661172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:53.693924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03c3e-9a0c-4725-b157-575bacc999ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.694786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03c3e-9a0c-4725-b157-575bacc999ac None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.695070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03c3e-9a0c-4725-b157-575bacc999ac None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.695347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de03c3e-9a0c-4725-b157-575bacc999ac None admin] PATH_INFO: `/v3/groups/dce74a38cafd4e48b593f62d135e2849` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.696566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de03c3e-9a0c-4725-b157-575bacc999ac None admin] RBAC: Authorizing `identity:get_group(group_id=dce74a38cafd4e48b593f62d135e2849)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.698066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de03c3e-9a0c-4725-b157-575bacc999ac None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.700292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 230/452] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:53 2022] GET /identity/v3/groups/dce74a38cafd4e48b593f62d135e2849 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:53.707227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03c3e-9a0c-4725-b157-575bacc999ac None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:53.724051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:53.780725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbaaf0d-94f7-4b29-a52c-7d3691839aef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:53.819329 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b71264-5d3c-4dbf-beaa-fda4d08dc629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.820217 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b71264-5d3c-4dbf-beaa-fda4d08dc629 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.820489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b71264-5d3c-4dbf-beaa-fda4d08dc629 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.820757 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b71264-5d3c-4dbf-beaa-fda4d08dc629 None admin] PATH_INFO: `/v3/groups/227e539ea22342da87fc7a40e5462206` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.822056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b71264-5d3c-4dbf-beaa-fda4d08dc629 None admin] RBAC: Authorizing `identity:get_group(group_id=227e539ea22342da87fc7a40e5462206)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.824012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b71264-5d3c-4dbf-beaa-fda4d08dc629 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.826752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de03c3e-9a0c-4725-b157-575bacc999ac None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:53.827290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 223/453] 10.222.0.85 () {56 vars in 1180 bytes} [Wed Jul 20 21:49:53 2022] GET /identity/v3/groups/227e539ea22342da87fc7a40e5462206 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:53.833206 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b71264-5d3c-4dbf-beaa-fda4d08dc629 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:53.866883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ba392-fe5e-4a77-a7f2-f2de796e1fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.867540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ba392-fe5e-4a77-a7f2-f2de796e1fdc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.867820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ba392-fe5e-4a77-a7f2-f2de796e1fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.868164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ba392-fe5e-4a77-a7f2-f2de796e1fdc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.869024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ba392-fe5e-4a77-a7f2-f2de796e1fdc None admin] RBAC: Adding query filter params (group.id=dce74a38cafd4e48b593f62d135e2849, role.id=5b16ed690a6942c288df268569b6ab85, scope.project.id=18d10b4af4be46f482585d23de6e290d) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:53.869331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ba392-fe5e-4a77-a7f2-f2de796e1fdc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.870763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ba392-fe5e-4a77-a7f2-f2de796e1fdc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.876761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 231/454] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Jul 20 21:49:53 2022] GET /identity/v3/role_assignments?group.id=dce74a38cafd4e48b593f62d135e2849&scope.project.id=18d10b4af4be46f482585d23de6e290d&role.id=5b16ed690a6942c288df268569b6ab85 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:53.915572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:53.948966 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b71264-5d3c-4dbf-beaa-fda4d08dc629 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:53.986172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c65dd-0123-42d8-a6a8-f68096047342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:53.986845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c65dd-0123-42d8-a6a8-f68096047342 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:53.987127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c65dd-0123-42d8-a6a8-f68096047342 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:53.987402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c65dd-0123-42d8-a6a8-f68096047342 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:53.988279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c65dd-0123-42d8-a6a8-f68096047342 None admin] RBAC: Adding query filter params (group.id=227e539ea22342da87fc7a40e5462206, role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=e58c029bf3c74b4692bf7afb2155976a) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:53.988595 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c65dd-0123-42d8-a6a8-f68096047342 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:53.990098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c65dd-0123-42d8-a6a8-f68096047342 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:53.997110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 224/455] 10.222.0.85 () {56 vars in 1376 bytes} [Wed Jul 20 21:49:53 2022] GET /identity/v3/role_assignments?group.id=227e539ea22342da87fc7a40e5462206&scope.project.id=e58c029bf3c74b4692bf7afb2155976a&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:56.687791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f1b3-e411-4f2e-b7c9-206e7ee3c711 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:56.688354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f1b3-e411-4f2e-b7c9-206e7ee3c711 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:56.688354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f1b3-e411-4f2e-b7c9-206e7ee3c711 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:56.690023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 232/456] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:56.695521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726ad84-6ecc-4b3b-98fa-e09057b39a97 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:56.695946 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726ad84-6ecc-4b3b-98fa-e09057b39a97 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:56.696151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726ad84-6ecc-4b3b-98fa-e09057b39a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:56.716995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e726ad84-6ecc-4b3b-98fa-e09057b39a97 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:56.718293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e726ad84-6ecc-4b3b-98fa-e09057b39a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:56.803318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 225/457] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:49:56.826094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcb3c4-0a02-45b8-9087-24575c3d35e9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:56.826402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcb3c4-0a02-45b8-9087-24575c3d35e9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:56.826658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdcb3c4-0a02-45b8-9087-24575c3d35e9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:56.828369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 233/458] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:49:56.833500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31fc47-bc25-46f8-9630-93f3a496b97e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:56.833787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31fc47-bc25-46f8-9630-93f3a496b97e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:56.834063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e31fc47-bc25-46f8-9630-93f3a496b97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:56.842539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcb3c4-0a02-45b8-9087-24575c3d35e9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:56.854231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6e31fc47-bc25-46f8-9630-93f3a496b97e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:56.856133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6e31fc47-bc25-46f8-9630-93f3a496b97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:56.964697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:56.980077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 226/459] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:56.982429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488404f-dfe8-4f1e-a083-8fa8af64b847 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:56.982721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488404f-dfe8-4f1e-a083-8fa8af64b847 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:56.983003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488404f-dfe8-4f1e-a083-8fa8af64b847 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:56.984317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 227/460] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:56.995469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2023a-49ee-4718-84c4-05a1974dd5ad None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:56.995845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2023a-49ee-4718-84c4-05a1974dd5ad None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:56.996650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2023a-49ee-4718-84c4-05a1974dd5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.008415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:57.025112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c0f2023a-49ee-4718-84c4-05a1974dd5ad None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:57.026606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c0f2023a-49ee-4718-84c4-05a1974dd5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:57.039552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdcb3c4-0a02-45b8-9087-24575c3d35e9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:57.085268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9d0e1-83e7-4b62-97ed-463764d1eaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:57.086477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9d0e1-83e7-4b62-97ed-463764d1eaff None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:57.086759 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9d0e1-83e7-4b62-97ed-463764d1eaff None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:57.087034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9d0e1-83e7-4b62-97ed-463764d1eaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.100646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9d0e1-83e7-4b62-97ed-463764d1eaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:57.102586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9d0e1-83e7-4b62-97ed-463764d1eaff None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:57.116023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 228/461] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:57.116935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2023a-49ee-4718-84c4-05a1974dd5ad None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-fca9d0e1-83e7-4b62-97ed-463764d1eaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:49:57.130320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:57.132313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:57.134333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:49:57.134333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:49:57.134333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:49:57.134333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:57.139941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 234/462] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:57.139941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9d0e1-83e7-4b62-97ed-463764d1eaff None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:57.246335 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2023a-49ee-4718-84c4-05a1974dd5ad None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:57.256448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9d0e1-83e7-4b62-97ed-463764d1eaff None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:57.271808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:57.283998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a24d84c-806f-4966-9d4b-f6da4aa89ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:57.285019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d84c-806f-4966-9d4b-f6da4aa89ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:57.285298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d84c-806f-4966-9d4b-f6da4aa89ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:57.289518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a24d84c-806f-4966-9d4b-f6da4aa89ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.289627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:57.295230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc21320-5946-4647-825d-cac9c5f94173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:57.295812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc21320-5946-4647-825d-cac9c5f94173 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:57.296128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc21320-5946-4647-825d-cac9c5f94173 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:57.296424 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc21320-5946-4647-825d-cac9c5f94173 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.297071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24d84c-806f-4966-9d4b-f6da4aa89ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:57.297166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc21320-5946-4647-825d-cac9c5f94173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:57.297444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc21320-5946-4647-825d-cac9c5f94173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:57.298548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a24d84c-806f-4966-9d4b-f6da4aa89ad3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:57.298800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc21320-5946-4647-825d-cac9c5f94173 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:57.310872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 235/463] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:49:57.311579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc21320-5946-4647-825d-cac9c5f94173 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0a24d84c-806f-4966-9d4b-f6da4aa89ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:49:57.319209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:57.324644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:57.325483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:49:57.325483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:49:57.325483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:49:57.325483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:49:57.325483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 229/464] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:57.325483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939ff5-49ee-4669-897b-bc111662fc8d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:57.325483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939ff5-49ee-4669-897b-bc111662fc8d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:57.325483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5939ff5-49ee-4669-897b-bc111662fc8d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.328259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 230/465] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:57.329182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5939ff5-49ee-4669-897b-bc111662fc8d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:57.428580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc21320-5946-4647-825d-cac9c5f94173 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:57.442030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5939ff5-49ee-4669-897b-bc111662fc8d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:57.468783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feda2d-182e-4968-a5ad-ad417bff134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:57.469581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feda2d-182e-4968-a5ad-ad417bff134f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:57.469860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feda2d-182e-4968-a5ad-ad417bff134f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:57.470131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86feda2d-182e-4968-a5ad-ad417bff134f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.477435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27540090-27d2-4f88-8355-8aef77528a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:57.478099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540090-27d2-4f88-8355-8aef77528a94 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:57.478379 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540090-27d2-4f88-8355-8aef77528a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:57.478653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27540090-27d2-4f88-8355-8aef77528a94 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.479361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27540090-27d2-4f88-8355-8aef77528a94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:57.481615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27540090-27d2-4f88-8355-8aef77528a94 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:57.482827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86feda2d-182e-4968-a5ad-ad417bff134f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:57.484291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86feda2d-182e-4968-a5ad-ad417bff134f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-86feda2d-182e-4968-a5ad-ad417bff134f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:49:57.502173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:57.503022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:57.509528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:49:57.509528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:49:57.509528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:49:57.509528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:57.509528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 236/466] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:57.509528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feda2d-182e-4968-a5ad-ad417bff134f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:57.551364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:57.570015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 231/467] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:57 2022] POST /identity/v3/users => generated 246 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:57.580929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a98d0-283f-4ec5-a4ea-964ffbab65a9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:57.581227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a98d0-283f-4ec5-a4ea-964ffbab65a9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:57.581495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a98d0-283f-4ec5-a4ea-964ffbab65a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.611484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86feda2d-182e-4968-a5ad-ad417bff134f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:57.628347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-da2a98d0-283f-4ec5-a4ea-964ffbab65a9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:57.629590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-da2a98d0-283f-4ec5-a4ea-964ffbab65a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:57.653376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a32d8-0d70-4008-aa1b-3e04fd8f5699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:57.654599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a32d8-0d70-4008-aa1b-3e04fd8f5699 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:57.655162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a32d8-0d70-4008-aa1b-3e04fd8f5699 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:57.655704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a32d8-0d70-4008-aa1b-3e04fd8f5699 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.656736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a32d8-0d70-4008-aa1b-3e04fd8f5699 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:57.657314 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a32d8-0d70-4008-aa1b-3e04fd8f5699 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:57.659200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a32d8-0d70-4008-aa1b-3e04fd8f5699 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:57.661619 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:57.676049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 237/468] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:57.677325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a32d8-0d70-4008-aa1b-3e04fd8f5699 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:57.720459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 232/469] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:57.721466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a98d0-283f-4ec5-a4ea-964ffbab65a9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:57.792387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:57.796430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a32d8-0d70-4008-aa1b-3e04fd8f5699 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:57.835206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97006a-a4f4-4f42-ab36-3802ee72ca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:57.835875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97006a-a4f4-4f42-ab36-3802ee72ca14 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:57.836208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97006a-a4f4-4f42-ab36-3802ee72ca14 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:57.836486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d97006a-a4f4-4f42-ab36-3802ee72ca14 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.837379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97006a-a4f4-4f42-ab36-3802ee72ca14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:57.837693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97006a-a4f4-4f42-ab36-3802ee72ca14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:57.840695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d97006a-a4f4-4f42-ab36-3802ee72ca14 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:57.852337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 238/470] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:57.853262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97006a-a4f4-4f42-ab36-3802ee72ca14 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:57.925235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a98d0-283f-4ec5-a4ea-964ffbab65a9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:57.962357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4736f7e-0447-45e5-aaa0-c142271c88ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:57.963035 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4736f7e-0447-45e5-aaa0-c142271c88ee None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:57.963316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4736f7e-0447-45e5-aaa0-c142271c88ee None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:57.963594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4736f7e-0447-45e5-aaa0-c142271c88ee None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:57.964329 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4736f7e-0447-45e5-aaa0-c142271c88ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:57.965814 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4736f7e-0447-45e5-aaa0-c142271c88ee None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:58.004126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d97006a-a4f4-4f42-ab36-3802ee72ca14 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:58.039192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35231b3-2af7-4cfa-96db-dfda18012e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:58.040016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35231b3-2af7-4cfa-96db-dfda18012e7c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:58.040302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35231b3-2af7-4cfa-96db-dfda18012e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:58.040576 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35231b3-2af7-4cfa-96db-dfda18012e7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:58.051407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35231b3-2af7-4cfa-96db-dfda18012e7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:58.052916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35231b3-2af7-4cfa-96db-dfda18012e7c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:58.064612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 233/471] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:57 2022] POST /identity/v3/users => generated 248 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c35231b3-2af7-4cfa-96db-dfda18012e7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:49:58.073359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:58.074960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:58.076145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:49:58.076145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:49:58.076145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:49:58.076145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:58.077327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4736f7e-0447-45e5-aaa0-c142271c88ee None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:58.080259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 239/472] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:49:58.082093 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85523479-33b8-4143-b932-d5fdf833523e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:58.082582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85523479-33b8-4143-b932-d5fdf833523e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:58.083445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85523479-33b8-4143-b932-d5fdf833523e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:58.091583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 240/473] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:49:58 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:49:58.092986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85523479-33b8-4143-b932-d5fdf833523e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:58.105063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:58.118088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:58.203778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4736f7e-0447-45e5-aaa0-c142271c88ee None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:58.225869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85523479-33b8-4143-b932-d5fdf833523e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:58.246410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29930d91-3728-4747-a7e5-82e45bfb5d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:58.247233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29930d91-3728-4747-a7e5-82e45bfb5d1b None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:58.247573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29930d91-3728-4747-a7e5-82e45bfb5d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:58.247852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29930d91-3728-4747-a7e5-82e45bfb5d1b None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:58.248583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29930d91-3728-4747-a7e5-82e45bfb5d1b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:58.250134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29930d91-3728-4747-a7e5-82e45bfb5d1b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:58.272442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d2b1cc-48fc-4ae8-8ce0-477fd6b5f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:58.272739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2b1cc-48fc-4ae8-8ce0-477fd6b5f30e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:58.273430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2b1cc-48fc-4ae8-8ce0-477fd6b5f30e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:58.273430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d2b1cc-48fc-4ae8-8ce0-477fd6b5f30e None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:58.273985 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2b1cc-48fc-4ae8-8ce0-477fd6b5f30e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:58.276172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2b1cc-48fc-4ae8-8ce0-477fd6b5f30e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:58.276172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d2b1cc-48fc-4ae8-8ce0-477fd6b5f30e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:58.289016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 241/474] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:49:58.290674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97aab-3291-4088-b2d0-b6cac9169bd7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:58.291157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97aab-3291-4088-b2d0-b6cac9169bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:58.291666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f97aab-3291-4088-b2d0-b6cac9169bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:58.310044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b8f97aab-3291-4088-b2d0-b6cac9169bd7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:49:58.311549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b8f97aab-3291-4088-b2d0-b6cac9169bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:49:58.366804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 234/475] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:58 2022] POST /identity/v3/users => generated 248 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:58.368069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29930d91-3728-4747-a7e5-82e45bfb5d1b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:58.391944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 242/476] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:49:58.416076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f97aab-3291-4088-b2d0-b6cac9169bd7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:58.425492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:58.531195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:58.580034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29930d91-3728-4747-a7e5-82e45bfb5d1b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:58.615561 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f97aab-3291-4088-b2d0-b6cac9169bd7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:58.634770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c788a-821a-4683-bf5a-b673f6c99b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:58.635410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c788a-821a-4683-bf5a-b673f6c99b3f None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:58.635689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c788a-821a-4683-bf5a-b673f6c99b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:58.637444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c788a-821a-4683-bf5a-b673f6c99b3f None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:58.637444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c788a-821a-4683-bf5a-b673f6c99b3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:58.639140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c788a-821a-4683-bf5a-b673f6c99b3f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:58.664087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2bcd4-c1ae-4ef6-9997-45752b2619f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:58.664087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2bcd4-c1ae-4ef6-9997-45752b2619f9 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:58.664359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2bcd4-c1ae-4ef6-9997-45752b2619f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:58.664462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2bcd4-c1ae-4ef6-9997-45752b2619f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:58.665244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2bcd4-c1ae-4ef6-9997-45752b2619f9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:58.666658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2bcd4-c1ae-4ef6-9997-45752b2619f9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:58.712441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.sql.core [None req-22f2bcd4-c1ae-4ef6-9997-45752b2619f9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 21:49:58.712441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 21:49:58.712441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [parameters: {'id': 'aab88f4b28af4ce6a7abb900e2e7a66f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 21:49:58.712441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80418) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-22f2bcd4-c1ae-4ef6-9997-45752b2619f9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application conn.query(q) Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application result.read() Jul 20 21:49:58.729721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return ref.to_dict() Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 21:49:58.730620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application next(self.gen) Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application yield resource Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application next(self.gen) Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise self.value Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application session.commit() Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 21:49:58.731717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.session.flush() Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application compat.raise_( Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 21:49:58.732619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 21:49:58.733670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application conn.query(q) Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application result.read() Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 21:49:58.734554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [parameters: {'id': 'aab88f4b28af4ce6a7abb900e2e7a66f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:58.735349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 20 21:49:58.736249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:58.737846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 243/477] 10.222.0.85 () {60 vars in 1131 bytes} [Wed Jul 20 21:49:58 2022] POST /identity/v3/roles => generated 144 bytes in 316 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:58.737991 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2bcd4-c1ae-4ef6-9997-45752b2619f9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:58.752815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 235/478] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:49:58 2022] POST /identity/v3/users => generated 249 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:49:58.827556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:58.874925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2bcd4-c1ae-4ef6-9997-45752b2619f9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:58.923644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d87334-5b5b-4f4f-8b80-83c335acde72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:58.924484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87334-5b5b-4f4f-8b80-83c335acde72 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:58.924762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87334-5b5b-4f4f-8b80-83c335acde72 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:58.925034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d87334-5b5b-4f4f-8b80-83c335acde72 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:58.951954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d87334-5b5b-4f4f-8b80-83c335acde72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-34d87334-5b5b-4f4f-8b80-83c335acde72 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:49:58.958192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:49:58.959259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:49:58.963056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 244/479] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:49:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:49:58.971962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c788a-821a-4683-bf5a-b673f6c99b3f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:49:59.121947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c788a-821a-4683-bf5a-b673f6c99b3f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:49:59.151858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:49:59.157813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf6725-49d5-488f-a51a-1649b3eecc61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:49:59.158489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6725-49d5-488f-a51a-1649b3eecc61 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:49:59.158771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6725-49d5-488f-a51a-1649b3eecc61 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:49:59.159046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf6725-49d5-488f-a51a-1649b3eecc61 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:49:59.159806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf6725-49d5-488f-a51a-1649b3eecc61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:49:59.160138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf6725-49d5-488f-a51a-1649b3eecc61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:49:59.166249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf6725-49d5-488f-a51a-1649b3eecc61 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:49:59.172390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 236/480] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:49:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:00.022242 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588ff91-fdf5-4d8b-b7cb-2231fdffc1b4 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:00.023194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588ff91-fdf5-4d8b-b7cb-2231fdffc1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:00.023663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588ff91-fdf5-4d8b-b7cb-2231fdffc1b4 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:00.025549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 245/481] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:00.031740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88604ca-5ed5-4e83-9df8-cb6ba9e7c48f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:00.032605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88604ca-5ed5-4e83-9df8-cb6ba9e7c48f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:00.033076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88604ca-5ed5-4e83-9df8-cb6ba9e7c48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:00.055845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f88604ca-5ed5-4e83-9df8-cb6ba9e7c48f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:00.057394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f88604ca-5ed5-4e83-9df8-cb6ba9e7c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:00.152036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 237/482] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:00.191827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588ff91-fdf5-4d8b-b7cb-2231fdffc1b4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:00.343409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c588ff91-fdf5-4d8b-b7cb-2231fdffc1b4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:00.379284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:00.392612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98e4c1-209d-4b91-beeb-b45c65d40574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:00.395425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98e4c1-209d-4b91-beeb-b45c65d40574 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:00.395425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98e4c1-209d-4b91-beeb-b45c65d40574 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:00.395425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98e4c1-209d-4b91-beeb-b45c65d40574 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:00.408872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98e4c1-209d-4b91-beeb-b45c65d40574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ed98e4c1-209d-4b91-beeb-b45c65d40574 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:00.416757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:00.417745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:00.418956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 246/483] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:00.427487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88604ca-5ed5-4e83-9df8-cb6ba9e7c48f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:00.584192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88604ca-5ed5-4e83-9df8-cb6ba9e7c48f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:00.618008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:00.633787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20923742-bc76-4c1a-8ccc-0bdead8d5364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:00.635497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20923742-bc76-4c1a-8ccc-0bdead8d5364 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:00.635497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20923742-bc76-4c1a-8ccc-0bdead8d5364 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:00.635497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20923742-bc76-4c1a-8ccc-0bdead8d5364 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:00.636765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20923742-bc76-4c1a-8ccc-0bdead8d5364 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:00.637314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20923742-bc76-4c1a-8ccc-0bdead8d5364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:00.638898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20923742-bc76-4c1a-8ccc-0bdead8d5364 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:00.653586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 238/484] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:00.661819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98e4c1-209d-4b91-beeb-b45c65d40574 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:00.787831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b0caf-caec-4c07-aa9a-a9945cc26c31 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:00.788151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b0caf-caec-4c07-aa9a-a9945cc26c31 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:00.793324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b0caf-caec-4c07-aa9a-a9945cc26c31 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:00.793324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 239/485] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:00.795631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b7e5a-763c-485d-a561-69de5d3a6766 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:00.795947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b7e5a-763c-485d-a561-69de5d3a6766 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:00.796231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b7e5a-763c-485d-a561-69de5d3a6766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:00.804027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98e4c1-209d-4b91-beeb-b45c65d40574 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:00.825186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cf5b7e5a-763c-485d-a561-69de5d3a6766 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:00.826382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cf5b7e5a-763c-485d-a561-69de5d3a6766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:00.860128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eccd84-b0ff-4fa0-a540-7a2437d42dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:00.861910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eccd84-b0ff-4fa0-a540-7a2437d42dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:00.862391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eccd84-b0ff-4fa0-a540-7a2437d42dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:00.863105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eccd84-b0ff-4fa0-a540-7a2437d42dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:00.876089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eccd84-b0ff-4fa0-a540-7a2437d42dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:00.877518 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eccd84-b0ff-4fa0-a540-7a2437d42dd7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f6eccd84-b0ff-4fa0-a540-7a2437d42dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:00.897555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:00.898476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:00.899779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:00.899779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:00.899779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:00.899779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:00.904245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 247/486] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:00.905773 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de9f47-d7e0-4d40-aaff-2f807a52b1ad None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:00.906439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de9f47-d7e0-4d40-aaff-2f807a52b1ad None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:00.906439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de9f47-d7e0-4d40-aaff-2f807a52b1ad None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:00.907666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 248/487] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:00.912363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de9f47-d7e0-4d40-aaff-2f807a52b1ad None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:00.920268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 240/488] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:00.922462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24013e3-673c-4908-8a5a-ce549fd13f21 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:00.923003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24013e3-673c-4908-8a5a-ce549fd13f21 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:00.923467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24013e3-673c-4908-8a5a-ce549fd13f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:00.947811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f24013e3-673c-4908-8a5a-ce549fd13f21 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:00.948845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f24013e3-673c-4908-8a5a-ce549fd13f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:00.965876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:01.032487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 241/489] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:01.034055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24013e3-673c-4908-8a5a-ce549fd13f21 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:01.064732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de9f47-d7e0-4d40-aaff-2f807a52b1ad None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:01.092886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:01.106052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ad4f6-f921-4601-ae8a-87e0efc918ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:01.106646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ad4f6-f921-4601-ae8a-87e0efc918ea None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.107006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ad4f6-f921-4601-ae8a-87e0efc918ea None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.107281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ad4f6-f921-4601-ae8a-87e0efc918ea None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.108055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ad4f6-f921-4601-ae8a-87e0efc918ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:01.108367 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ad4f6-f921-4601-ae8a-87e0efc918ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:01.109875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ad4f6-f921-4601-ae8a-87e0efc918ea None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:01.122755 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 249/490] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:01.123611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ad4f6-f921-4601-ae8a-87e0efc918ea None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:01.162107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24013e3-673c-4908-8a5a-ce549fd13f21 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:01.198874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778719-3352-47c0-b7e7-c67515bd7fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:01.199674 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778719-3352-47c0-b7e7-c67515bd7fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.200002 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778719-3352-47c0-b7e7-c67515bd7fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.200334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef778719-3352-47c0-b7e7-c67515bd7fe0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.211342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef778719-3352-47c0-b7e7-c67515bd7fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ef778719-3352-47c0-b7e7-c67515bd7fe0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:01.219906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:01.220830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:01.222056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 242/491] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:01.222864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778719-3352-47c0-b7e7-c67515bd7fe0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:01.264086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:01.269784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ad4f6-f921-4601-ae8a-87e0efc918ea None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:01.312688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a5743-d0eb-4bb7-ab5b-30fdbcbb73fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:01.313158 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a5743-d0eb-4bb7-ab5b-30fdbcbb73fd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.313440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a5743-d0eb-4bb7-ab5b-30fdbcbb73fd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.313713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a5743-d0eb-4bb7-ab5b-30fdbcbb73fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.325377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a5743-d0eb-4bb7-ab5b-30fdbcbb73fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2c1a5743-d0eb-4bb7-ab5b-30fdbcbb73fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:01.333776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:01.334661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 250/492] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:01.335893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a5743-d0eb-4bb7-ab5b-30fdbcbb73fd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:01.347537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef778719-3352-47c0-b7e7-c67515bd7fe0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:01.350291 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:01.401838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b043081-8556-44d6-992a-b454d4754178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:01.403509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b043081-8556-44d6-992a-b454d4754178 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.404259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b043081-8556-44d6-992a-b454d4754178 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.405146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b043081-8556-44d6-992a-b454d4754178 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.416861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b043081-8556-44d6-992a-b454d4754178 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:01.419476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b043081-8556-44d6-992a-b454d4754178 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8b043081-8556-44d6-992a-b454d4754178 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:01.440468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:01.441438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:01.442337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:01.442337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:01.442337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:01.442337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:01.442337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:01.442337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:01.442337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:01.442337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:01.442337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:01.442337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:01.445506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 243/493] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Jul 20 21:50:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:01.446916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b043081-8556-44d6-992a-b454d4754178 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:01.465069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a5743-d0eb-4bb7-ab5b-30fdbcbb73fd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:01.503482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fec0b-0905-44ad-92db-b7c756110a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:01.504279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fec0b-0905-44ad-92db-b7c756110a97 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.504458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fec0b-0905-44ad-92db-b7c756110a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.504820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fec0b-0905-44ad-92db-b7c756110a97 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.505586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fec0b-0905-44ad-92db-b7c756110a97 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:01.505897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fec0b-0905-44ad-92db-b7c756110a97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:01.507292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fec0b-0905-44ad-92db-b7c756110a97 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:01.517669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 251/494] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:01.518569 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fec0b-0905-44ad-92db-b7c756110a97 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:01.545104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:01.570160 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b043081-8556-44d6-992a-b454d4754178 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:01.609278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c285b6e-88ea-4e73-b63e-4e3f85542f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:01.609982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285b6e-88ea-4e73-b63e-4e3f85542f81 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.610271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285b6e-88ea-4e73-b63e-4e3f85542f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.610582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c285b6e-88ea-4e73-b63e-4e3f85542f81 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.611334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c285b6e-88ea-4e73-b63e-4e3f85542f81 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:01.611644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c285b6e-88ea-4e73-b63e-4e3f85542f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:01.613290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c285b6e-88ea-4e73-b63e-4e3f85542f81 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:01.626828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 244/495] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:01.626828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e173ff7-3589-4a4c-b02c-e3c7bec9d221 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.626828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e173ff7-3589-4a4c-b02c-e3c7bec9d221 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.626828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e173ff7-3589-4a4c-b02c-e3c7bec9d221 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.626828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 245/496] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:01.626828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e173ff7-3589-4a4c-b02c-e3c7bec9d221 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:01.635613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fec0b-0905-44ad-92db-b7c756110a97 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:01.657985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:01.674853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5788c-99c7-47f9-9526-330067667074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:01.675435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5788c-99c7-47f9-9526-330067667074 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.675717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5788c-99c7-47f9-9526-330067667074 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.676009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5788c-99c7-47f9-9526-330067667074 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.676845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5788c-99c7-47f9-9526-330067667074 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:01.677152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5788c-99c7-47f9-9526-330067667074 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:01.678814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5788c-99c7-47f9-9526-330067667074 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:01.721582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 252/497] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Jul 20 21:50:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:01.721582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5788c-99c7-47f9-9526-330067667074 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:01.743942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e173ff7-3589-4a4c-b02c-e3c7bec9d221 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:01.782909 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc335c4-99c9-4ce2-8963-ebf69c35a22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:01.783827 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc335c4-99c9-4ce2-8963-ebf69c35a22a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.784228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc335c4-99c9-4ce2-8963-ebf69c35a22a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.784501 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc335c4-99c9-4ce2-8963-ebf69c35a22a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.796932 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc335c4-99c9-4ce2-8963-ebf69c35a22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:01.798443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc335c4-99c9-4ce2-8963-ebf69c35a22a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:01.800550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-acc335c4-99c9-4ce2-8963-ebf69c35a22a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:01.817552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:01.818553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:01.819421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:01.819421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:01.819421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:01.819421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:01.819421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 246/498] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:01.820033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93400d-4d16-4849-b755-c1f9a2c3e40c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.820302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93400d-4d16-4849-b755-c1f9a2c3e40c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.820572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93400d-4d16-4849-b755-c1f9a2c3e40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.831829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5788c-99c7-47f9-9526-330067667074 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:01.839196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4d93400d-4d16-4849-b755-c1f9a2c3e40c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:01.840963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4d93400d-4d16-4849-b755-c1f9a2c3e40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:01.869437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f426e3-0ad9-417a-9222-3edce3b12357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:01.870470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f426e3-0ad9-417a-9222-3edce3b12357 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:01.871271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f426e3-0ad9-417a-9222-3edce3b12357 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:01.871542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f426e3-0ad9-417a-9222-3edce3b12357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:01.881761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f426e3-0ad9-417a-9222-3edce3b12357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:01.883321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f426e3-0ad9-417a-9222-3edce3b12357 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d8f426e3-0ad9-417a-9222-3edce3b12357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:01.902181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:01.903283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:01.904216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:01.904216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:01.904216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:01.904216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:01.904216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 253/499] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:01.904216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f426e3-0ad9-417a-9222-3edce3b12357 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:01.915247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 247/500] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:01.916123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93400d-4d16-4849-b755-c1f9a2c3e40c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:01.927482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:02.008292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f426e3-0ad9-417a-9222-3edce3b12357 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.022777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d93400d-4d16-4849-b755-c1f9a2c3e40c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.037865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:02.044182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239c560-05b4-4ce7-8f8f-320a81ed6f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.044821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c560-05b4-4ce7-8f8f-320a81ed6f9f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.045166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c560-05b4-4ce7-8f8f-320a81ed6f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.045419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239c560-05b4-4ce7-8f8f-320a81ed6f9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.057498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d82af1-db4e-451c-9ec2-c00881d76eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.058751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82af1-db4e-451c-9ec2-c00881d76eda None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.059121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82af1-db4e-451c-9ec2-c00881d76eda None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.059358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d82af1-db4e-451c-9ec2-c00881d76eda None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.060264 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d82af1-db4e-451c-9ec2-c00881d76eda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:02.060775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d82af1-db4e-451c-9ec2-c00881d76eda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:02.062651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d82af1-db4e-451c-9ec2-c00881d76eda None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:02.074748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 248/501] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:02.076049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0d330-252e-46d6-94a7-bc6cd17d6f3e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.076343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0d330-252e-46d6-94a7-bc6cd17d6f3e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.076662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0d330-252e-46d6-94a7-bc6cd17d6f3e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.079830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 249/502] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:02.079830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0d330-252e-46d6-94a7-bc6cd17d6f3e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:02.115195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239c560-05b4-4ce7-8f8f-320a81ed6f9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:02.116797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239c560-05b4-4ce7-8f8f-320a81ed6f9f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:02.148191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:02.184585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0d330-252e-46d6-94a7-bc6cd17d6f3e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.218196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa19e6-bc99-4908-94b9-de66e05af648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.218367 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 254/503] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:02.219044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239c560-05b4-4ce7-8f8f-320a81ed6f9f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:02.219171 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa19e6-bc99-4908-94b9-de66e05af648 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.219439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa19e6-bc99-4908-94b9-de66e05af648 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.219717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa19e6-bc99-4908-94b9-de66e05af648 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.220467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa19e6-bc99-4908-94b9-de66e05af648 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:02.220774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa19e6-bc99-4908-94b9-de66e05af648 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:02.222164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa19e6-bc99-4908-94b9-de66e05af648 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:02.234484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 250/504] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:02.235278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa19e6-bc99-4908-94b9-de66e05af648 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:02.252919 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:02.323072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239c560-05b4-4ce7-8f8f-320a81ed6f9f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.335743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa19e6-bc99-4908-94b9-de66e05af648 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.357767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ae0e04-bed4-43ef-bfdf-e25e401749a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.358604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0e04-bed4-43ef-bfdf-e25e401749a7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.358930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0e04-bed4-43ef-bfdf-e25e401749a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.359209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ae0e04-bed4-43ef-bfdf-e25e401749a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.362628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:02.369220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ae0e04-bed4-43ef-bfdf-e25e401749a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:02.370289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509e4d-dc7e-4886-8922-0411633f73eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.371389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509e4d-dc7e-4886-8922-0411633f73eb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.375236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509e4d-dc7e-4886-8922-0411633f73eb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.375236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa509e4d-dc7e-4886-8922-0411633f73eb None admin] PATH_INFO: `/v3/users/glance` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f4ae0e04-bed4-43ef-bfdf-e25e401749a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:02.377239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:02.378225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:02.379076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 255/505] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:02.380617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509e4d-dc7e-4886-8922-0411633f73eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:02.380698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242abf45-372e-455d-8a62-c3a9dac98c5c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.380698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242abf45-372e-455d-8a62-c3a9dac98c5c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.380698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242abf45-372e-455d-8a62-c3a9dac98c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.380885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa509e4d-dc7e-4886-8922-0411633f73eb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-aa509e4d-dc7e-4886-8922-0411633f73eb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:02.398873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:02.399874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:02.406879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:02.406879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:02.406879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:02.406879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:02.406879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:02.406879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:02.406879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:02.406879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:02.406879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 21:50:02.406879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:02.407513 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-242abf45-372e-455d-8a62-c3a9dac98c5c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:02.407600 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 251/506] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:02.407688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-242abf45-372e-455d-8a62-c3a9dac98c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:02.407832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509e4d-dc7e-4886-8922-0411633f73eb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:02.467033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 256/507] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:02.467793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242abf45-372e-455d-8a62-c3a9dac98c5c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:02.489295 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:02.507361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa509e4d-dc7e-4886-8922-0411633f73eb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.547648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd97dd-11e5-4dbe-84ad-af670c68d151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.549535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd97dd-11e5-4dbe-84ad-af670c68d151 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.549535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd97dd-11e5-4dbe-84ad-af670c68d151 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.549535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd97dd-11e5-4dbe-84ad-af670c68d151 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.564035 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd97dd-11e5-4dbe-84ad-af670c68d151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:02.565513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd97dd-11e5-4dbe-84ad-af670c68d151 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:02.574735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242abf45-372e-455d-8a62-c3a9dac98c5c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7dbd97dd-11e5-4dbe-84ad-af670c68d151 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:02.583082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:02.584090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:02.585099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:02.585099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:02.585099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:02.585099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:02.585099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 252/508] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:02.585099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd97dd-11e5-4dbe-84ad-af670c68d151 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:02.614442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c17f76-e0a5-4551-ae3f-9dd9329492e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.615244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c17f76-e0a5-4551-ae3f-9dd9329492e6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.615509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c17f76-e0a5-4551-ae3f-9dd9329492e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.615775 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c17f76-e0a5-4551-ae3f-9dd9329492e6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.623034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c17f76-e0a5-4551-ae3f-9dd9329492e6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:02.624523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c17f76-e0a5-4551-ae3f-9dd9329492e6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:02.628359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b7c17f76-e0a5-4551-ae3f-9dd9329492e6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:02.640302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:02.641642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 257/509] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:02.642559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c17f76-e0a5-4551-ae3f-9dd9329492e6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:02.689780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd97dd-11e5-4dbe-84ad-af670c68d151 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.724183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c51d6-4800-4ad0-a233-0898906d8267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.724856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c51d6-4800-4ad0-a233-0898906d8267 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.725137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c51d6-4800-4ad0-a233-0898906d8267 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.725416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2c51d6-4800-4ad0-a233-0898906d8267 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.726156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c51d6-4800-4ad0-a233-0898906d8267 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:02.726461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c51d6-4800-4ad0-a233-0898906d8267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:02.727218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:02.727950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2c51d6-4800-4ad0-a233-0898906d8267 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:02.736425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 253/510] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:02.737214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c51d6-4800-4ad0-a233-0898906d8267 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:02.746471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c17f76-e0a5-4551-ae3f-9dd9329492e6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.782780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7731e-bf1b-46e5-a3cc-575249733756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.783446 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7731e-bf1b-46e5-a3cc-575249733756 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.783727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7731e-bf1b-46e5-a3cc-575249733756 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.784040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7731e-bf1b-46e5-a3cc-575249733756 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.784907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7731e-bf1b-46e5-a3cc-575249733756 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:02.785218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7731e-bf1b-46e5-a3cc-575249733756 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:02.786650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7731e-bf1b-46e5-a3cc-575249733756 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:02.804177 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 258/511] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:02.805102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7731e-bf1b-46e5-a3cc-575249733756 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:02.843573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2c51d6-4800-4ad0-a233-0898906d8267 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.845120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:02.877491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a637c-b3d8-42cd-9925-cd4b661f1355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.878384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a637c-b3d8-42cd-9925-cd4b661f1355 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.879023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a637c-b3d8-42cd-9925-cd4b661f1355 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.879296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a637c-b3d8-42cd-9925-cd4b661f1355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.891199 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a637c-b3d8-42cd-9925-cd4b661f1355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:02.892686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a637c-b3d8-42cd-9925-cd4b661f1355 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:02.904976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7731e-bf1b-46e5-a3cc-575249733756 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-415a637c-b3d8-42cd-9925-cd4b661f1355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:02.910154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:02.911138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:02.912225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:02.912225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:02.912225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:02.912225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:02.912225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 254/512] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:02.912656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a637c-b3d8-42cd-9925-cd4b661f1355 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:02.940863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7b5a4-786c-4370-b546-9cbd1e39f495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:02.941663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b5a4-786c-4370-b546-9cbd1e39f495 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:02.941938 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b5a4-786c-4370-b546-9cbd1e39f495 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:02.942206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b5a4-786c-4370-b546-9cbd1e39f495 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:02.942913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7b5a4-786c-4370-b546-9cbd1e39f495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:02.943216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7b5a4-786c-4370-b546-9cbd1e39f495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:02.944598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb7b5a4-786c-4370-b546-9cbd1e39f495 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:02.952381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:02.957908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 259/513] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:02.958762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7b5a4-786c-4370-b546-9cbd1e39f495 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:03.024730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a637c-b3d8-42cd-9925-cd4b661f1355 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:03.058377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7b5a4-786c-4370-b546-9cbd1e39f495 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:03.059088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b9ce-d22d-419f-a545-6a8687a906a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:03.059758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b9ce-d22d-419f-a545-6a8687a906a2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:03.060071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b9ce-d22d-419f-a545-6a8687a906a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:03.060348 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744b9ce-d22d-419f-a545-6a8687a906a2 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:03.061188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744b9ce-d22d-419f-a545-6a8687a906a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:03.061518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744b9ce-d22d-419f-a545-6a8687a906a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:03.063009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744b9ce-d22d-419f-a545-6a8687a906a2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:03.094097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb73aef-dbda-4108-aca3-d5ce83d60c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:03.094879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb73aef-dbda-4108-aca3-d5ce83d60c6c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:03.095158 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb73aef-dbda-4108-aca3-d5ce83d60c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:03.095426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb73aef-dbda-4108-aca3-d5ce83d60c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:03.100429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 255/514] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:03.101290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b9ce-d22d-419f-a545-6a8687a906a2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:03.106389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb73aef-dbda-4108-aca3-d5ce83d60c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:03.107828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb73aef-dbda-4108-aca3-d5ce83d60c6c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:03.118694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ebb73aef-dbda-4108-aca3-d5ce83d60c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:03.125403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:03.126581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:03.127488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:03.127488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:03.127488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:03.127488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:03.127488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 260/515] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:03.127488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb73aef-dbda-4108-aca3-d5ce83d60c6c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:03.181779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:03.207842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744b9ce-d22d-419f-a545-6a8687a906a2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:03.232914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb73aef-dbda-4108-aca3-d5ce83d60c6c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:03.241457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c9358-ed4f-43f1-890a-07a381d298ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:03.242188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c9358-ed4f-43f1-890a-07a381d298ec None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:03.242472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c9358-ed4f-43f1-890a-07a381d298ec None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:03.242996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c9358-ed4f-43f1-890a-07a381d298ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:03.267461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb805b35-e359-4a28-8e9e-2ba7d8d6da0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:03.268212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb805b35-e359-4a28-8e9e-2ba7d8d6da0b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:03.268493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb805b35-e359-4a28-8e9e-2ba7d8d6da0b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:03.268767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb805b35-e359-4a28-8e9e-2ba7d8d6da0b None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:03.269487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb805b35-e359-4a28-8e9e-2ba7d8d6da0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:03.269797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb805b35-e359-4a28-8e9e-2ba7d8d6da0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:03.271171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb805b35-e359-4a28-8e9e-2ba7d8d6da0b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:03.282653 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 261/516] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:03.283371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb805b35-e359-4a28-8e9e-2ba7d8d6da0b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:03.310815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c9358-ed4f-43f1-890a-07a381d298ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:03.312301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3c9358-ed4f-43f1-890a-07a381d298ec None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:03.327209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:03.380944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb805b35-e359-4a28-8e9e-2ba7d8d6da0b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:03.392515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:03.413282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 256/517] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:03.414150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c9358-ed4f-43f1-890a-07a381d298ec None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:03.418752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b362-cc68-4c1f-b182-2cb669174d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:03.419600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b362-cc68-4c1f-b182-2cb669174d99 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:03.419885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b362-cc68-4c1f-b182-2cb669174d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:03.420186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b362-cc68-4c1f-b182-2cb669174d99 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:03.427025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95b362-cc68-4c1f-b182-2cb669174d99 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:03.428524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95b362-cc68-4c1f-b182-2cb669174d99 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-5f95b362-cc68-4c1f-b182-2cb669174d99 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:03.443722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:03.444622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:03.445496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:03.445496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:03.445496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:03.445496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:03.445496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:03.445496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:03.445496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:03.445496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:03.445496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 262/518] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:03.445968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b362-cc68-4c1f-b182-2cb669174d99 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:03.518933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c9358-ed4f-43f1-890a-07a381d298ec None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:03.532555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:03.549690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b362-cc68-4c1f-b182-2cb669174d99 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:03.553643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538ec2-2668-4935-865d-9bf14a5c24df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:03.554286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538ec2-2668-4935-865d-9bf14a5c24df None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:03.554559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538ec2-2668-4935-865d-9bf14a5c24df None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:03.554825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19538ec2-2668-4935-865d-9bf14a5c24df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:03.583939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523134-8cad-43fe-ad8c-5dc33024e647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:03.584840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523134-8cad-43fe-ad8c-5dc33024e647 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:03.585217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523134-8cad-43fe-ad8c-5dc33024e647 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:03.585498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed523134-8cad-43fe-ad8c-5dc33024e647 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:03.586219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed523134-8cad-43fe-ad8c-5dc33024e647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:03.586524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed523134-8cad-43fe-ad8c-5dc33024e647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:03.587899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed523134-8cad-43fe-ad8c-5dc33024e647 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:03.604800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 263/519] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:03.606350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523134-8cad-43fe-ad8c-5dc33024e647 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:03.626345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538ec2-2668-4935-865d-9bf14a5c24df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:03.627830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19538ec2-2668-4935-865d-9bf14a5c24df None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:03.636768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:03.703785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed523134-8cad-43fe-ad8c-5dc33024e647 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:03.728127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 257/520] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:03.728975 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538ec2-2668-4935-865d-9bf14a5c24df None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:03.738080 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812716-4a8a-40a9-a3e7-cbd2d3f1b34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:03.738741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812716-4a8a-40a9-a3e7-cbd2d3f1b34b None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:03.739022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812716-4a8a-40a9-a3e7-cbd2d3f1b34b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:03.739289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1812716-4a8a-40a9-a3e7-cbd2d3f1b34b None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:03.740023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1812716-4a8a-40a9-a3e7-cbd2d3f1b34b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:03.741444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1812716-4a8a-40a9-a3e7-cbd2d3f1b34b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:03.745279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:03.827971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19538ec2-2668-4935-865d-9bf14a5c24df None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:03.832095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 264/521] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:50:03 2022] POST /identity/v3/users => generated 247 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:03.832920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812716-4a8a-40a9-a3e7-cbd2d3f1b34b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:03.878211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97896e7c-9c65-4ad5-816d-4b1d8cf5da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:03.879030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896e7c-9c65-4ad5-816d-4b1d8cf5da88 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:03.879313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896e7c-9c65-4ad5-816d-4b1d8cf5da88 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:03.879589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97896e7c-9c65-4ad5-816d-4b1d8cf5da88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:03.894514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97896e7c-9c65-4ad5-816d-4b1d8cf5da88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:03.896058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97896e7c-9c65-4ad5-816d-4b1d8cf5da88 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-97896e7c-9c65-4ad5-816d-4b1d8cf5da88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:03.915383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:03.916762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:03.918477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:03.918477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:03.918477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:03.918477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:03.918477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 258/522] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:03.918782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97896e7c-9c65-4ad5-816d-4b1d8cf5da88 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:03.941890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:03.960735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1812716-4a8a-40a9-a3e7-cbd2d3f1b34b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:03.998156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:04.005357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833b60e-ab17-40c2-814e-c98bb63f769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:04.006016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833b60e-ab17-40c2-814e-c98bb63f769c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:04.006288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833b60e-ab17-40c2-814e-c98bb63f769c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:04.006560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833b60e-ab17-40c2-814e-c98bb63f769c None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:04.007344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833b60e-ab17-40c2-814e-c98bb63f769c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:04.007646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833b60e-ab17-40c2-814e-c98bb63f769c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:04.009216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833b60e-ab17-40c2-814e-c98bb63f769c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:04.033412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 265/523] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:04.034379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833b60e-ab17-40c2-814e-c98bb63f769c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:04.046777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97896e7c-9c65-4ad5-816d-4b1d8cf5da88 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:04.084162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155e9da-8ff4-4a47-8e60-e1c8b2bb8403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:04.084875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155e9da-8ff4-4a47-8e60-e1c8b2bb8403 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:04.085152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155e9da-8ff4-4a47-8e60-e1c8b2bb8403 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:04.085422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155e9da-8ff4-4a47-8e60-e1c8b2bb8403 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:04.094070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155e9da-8ff4-4a47-8e60-e1c8b2bb8403 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:04.095703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155e9da-8ff4-4a47-8e60-e1c8b2bb8403 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f155e9da-8ff4-4a47-8e60-e1c8b2bb8403 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:04.112444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:04.113459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:04.114333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 259/524] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:04.114895 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155e9da-8ff4-4a47-8e60-e1c8b2bb8403 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:04.149775 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833b60e-ab17-40c2-814e-c98bb63f769c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:04.187053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab702f33-0d29-4d2b-a2ea-ca0d33c85d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:04.187867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702f33-0d29-4d2b-a2ea-ca0d33c85d5a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:04.188178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702f33-0d29-4d2b-a2ea-ca0d33c85d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:04.188454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab702f33-0d29-4d2b-a2ea-ca0d33c85d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:04.199081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab702f33-0d29-4d2b-a2ea-ca0d33c85d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:04.200585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab702f33-0d29-4d2b-a2ea-ca0d33c85d5a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:04.207667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ab702f33-0d29-4d2b-a2ea-ca0d33c85d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:04.219821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:04.226144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:04.227076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:04.227076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:04.227076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:04.227076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:04.227292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155e9da-8ff4-4a47-8e60-e1c8b2bb8403 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:04.227372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 266/525] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:04.227372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab702f33-0d29-4d2b-a2ea-ca0d33c85d5a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:04.257739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:04.270522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163bb9-0c73-4ad7-930a-891a623e46bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:04.271361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163bb9-0c73-4ad7-930a-891a623e46bd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:04.280138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163bb9-0c73-4ad7-930a-891a623e46bd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:04.280138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea163bb9-0c73-4ad7-930a-891a623e46bd None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:04.280138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea163bb9-0c73-4ad7-930a-891a623e46bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:04.280138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea163bb9-0c73-4ad7-930a-891a623e46bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:04.280138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea163bb9-0c73-4ad7-930a-891a623e46bd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:04.286928 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 260/526] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:04.287748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163bb9-0c73-4ad7-930a-891a623e46bd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:04.335677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab702f33-0d29-4d2b-a2ea-ca0d33c85d5a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:04.375379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a3614-de27-4209-84cf-e90c9cc5d33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:04.376057 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a3614-de27-4209-84cf-e90c9cc5d33a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:04.376333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a3614-de27-4209-84cf-e90c9cc5d33a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:04.376603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8a3614-de27-4209-84cf-e90c9cc5d33a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:04.377429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a3614-de27-4209-84cf-e90c9cc5d33a None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=5e192a50b09b49b4b7db2508ecf75af5) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:04.377848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a3614-de27-4209-84cf-e90c9cc5d33a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:04.379392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8a3614-de27-4209-84cf-e90c9cc5d33a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:04.391962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 267/527] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:04 2022] GET /identity/v3/role_assignments?user.id=5e192a50b09b49b4b7db2508ecf75af5&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:04.391962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a3614-de27-4209-84cf-e90c9cc5d33a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:04.414263 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea163bb9-0c73-4ad7-930a-891a623e46bd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:04.457156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8217b-aa43-40e1-8374-e9babf0652b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:04.458270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8217b-aa43-40e1-8374-e9babf0652b8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:04.458623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8217b-aa43-40e1-8374-e9babf0652b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:04.458904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b8217b-aa43-40e1-8374-e9babf0652b8 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:04.459762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8217b-aa43-40e1-8374-e9babf0652b8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:04.460095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8217b-aa43-40e1-8374-e9babf0652b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:04.461699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b8217b-aa43-40e1-8374-e9babf0652b8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:04.474260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:04.486825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 261/528] 10.222.0.85 () {56 vars in 1139 bytes} [Wed Jul 20 21:50:04 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:04.487874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8217b-aa43-40e1-8374-e9babf0652b8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:04.519703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8a3614-de27-4209-84cf-e90c9cc5d33a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:04.537510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:04.563208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d930732-a70b-479d-bd5b-6af981237ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:04.563575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d930732-a70b-479d-bd5b-6af981237ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:04.563752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d930732-a70b-479d-bd5b-6af981237ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:04.565680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d930732-a70b-479d-bd5b-6af981237ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:04.565680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d930732-a70b-479d-bd5b-6af981237ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:04.565680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d930732-a70b-479d-bd5b-6af981237ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:04.566461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d930732-a70b-479d-bd5b-6af981237ca4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:04.587449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 268/529] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:04.588305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d930732-a70b-479d-bd5b-6af981237ca4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:04.614240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b8217b-aa43-40e1-8374-e9babf0652b8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:04.661945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e5c4c-f4fd-429d-ae75-a5556dd1ae32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:04.663368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e5c4c-f4fd-429d-ae75-a5556dd1ae32 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:04.663852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e5c4c-f4fd-429d-ae75-a5556dd1ae32 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:04.664503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e5c4c-f4fd-429d-ae75-a5556dd1ae32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:04.674235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e5c4c-f4fd-429d-ae75-a5556dd1ae32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:04.676504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e5c4c-f4fd-429d-ae75-a5556dd1ae32 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f27e5c4c-f4fd-429d-ae75-a5556dd1ae32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:04.694134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:04.695031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:04.695873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:04.695873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:04.695873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:04.695873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:04.695873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:04.695873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:04.695873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:04.695873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:04.700399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 262/530] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:04.701330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e5c4c-f4fd-429d-ae75-a5556dd1ae32 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:04.701968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d930732-a70b-479d-bd5b-6af981237ca4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:04.732664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:04.747692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713edef-eba2-4633-923a-c91a84e7e313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:04.748716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713edef-eba2-4633-923a-c91a84e7e313 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:04.748997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713edef-eba2-4633-923a-c91a84e7e313 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:04.750665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713edef-eba2-4633-923a-c91a84e7e313 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:04.828535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e5c4c-f4fd-429d-ae75-a5556dd1ae32 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:04.829180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713edef-eba2-4633-923a-c91a84e7e313 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:04.830640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713edef-eba2-4633-923a-c91a84e7e313 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:04.831052 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:04.869272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cca083-f736-4204-ae8c-b313f72eadf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:04.870868 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cca083-f736-4204-ae8c-b313f72eadf1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:04.871612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cca083-f736-4204-ae8c-b313f72eadf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:04.872112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cca083-f736-4204-ae8c-b313f72eadf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:04.879631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cca083-f736-4204-ae8c-b313f72eadf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:04.881424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cca083-f736-4204-ae8c-b313f72eadf1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-90cca083-f736-4204-ae8c-b313f72eadf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:04.897205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:04.898077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:04.898915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:04.898915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:04.898915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:04.898915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:04.898915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:04.898915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:04.898915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:04.898915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:04.901460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 263/531] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:04.903189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cca083-f736-4204-ae8c-b313f72eadf1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:04.944054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 269/532] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:04.947883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713edef-eba2-4633-923a-c91a84e7e313 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:04.976655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:05.031659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cca083-f736-4204-ae8c-b313f72eadf1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:05.067970 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713edef-eba2-4633-923a-c91a84e7e313 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:05.083341 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84d93-e318-4cd7-a775-eaff33d2b301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:05.085491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84d93-e318-4cd7-a775-eaff33d2b301 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:05.086026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84d93-e318-4cd7-a775-eaff33d2b301 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:05.086026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee84d93-e318-4cd7-a775-eaff33d2b301 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:05.086817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee84d93-e318-4cd7-a775-eaff33d2b301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:05.087123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee84d93-e318-4cd7-a775-eaff33d2b301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:05.088589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee84d93-e318-4cd7-a775-eaff33d2b301 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:05.112204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 264/533] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:05.112814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cff92-7131-4875-8109-bd600a654764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:05.113079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84d93-e318-4cd7-a775-eaff33d2b301 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:05.113930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cff92-7131-4875-8109-bd600a654764 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:05.114414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cff92-7131-4875-8109-bd600a654764 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:05.114886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806cff92-7131-4875-8109-bd600a654764 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:05.115875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cff92-7131-4875-8109-bd600a654764 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:05.116590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cff92-7131-4875-8109-bd600a654764 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:05.119123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806cff92-7131-4875-8109-bd600a654764 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:05.139613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 270/534] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:05.141043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cff92-7131-4875-8109-bd600a654764 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:05.144377 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:05.228853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee84d93-e318-4cd7-a775-eaff33d2b301 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:05.252614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:05.266935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795868c-4efd-4227-994c-37f1d1bbafec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:05.267783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795868c-4efd-4227-994c-37f1d1bbafec None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:05.268233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795868c-4efd-4227-994c-37f1d1bbafec None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:05.268621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795868c-4efd-4227-994c-37f1d1bbafec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:05.275382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806cff92-7131-4875-8109-bd600a654764 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:05.281330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795868c-4efd-4227-994c-37f1d1bbafec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:05.282819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795868c-4efd-4227-994c-37f1d1bbafec None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e795868c-4efd-4227-994c-37f1d1bbafec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:05.306950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:05.308580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:05.309667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:05.309667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:05.309667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:05.309667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:05.309667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 265/535] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:05.309948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795868c-4efd-4227-994c-37f1d1bbafec None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:05.318515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ecfa6-e85e-4d53-a3c9-c39251c2e01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:05.319870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ecfa6-e85e-4d53-a3c9-c39251c2e01e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:05.320407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ecfa6-e85e-4d53-a3c9-c39251c2e01e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:05.320892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23ecfa6-e85e-4d53-a3c9-c39251c2e01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:05.322313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ecfa6-e85e-4d53-a3c9-c39251c2e01e None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=2169b05e64224f69bcc1d9ce912a60e1) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:05.323127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ecfa6-e85e-4d53-a3c9-c39251c2e01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:05.325071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23ecfa6-e85e-4d53-a3c9-c39251c2e01e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:05.335319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 271/536] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:05 2022] GET /identity/v3/role_assignments?user.id=2169b05e64224f69bcc1d9ce912a60e1&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:05.336377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ecfa6-e85e-4d53-a3c9-c39251c2e01e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:05.476305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:05.531720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795868c-4efd-4227-994c-37f1d1bbafec None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:05.548354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23ecfa6-e85e-4d53-a3c9-c39251c2e01e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:05.574767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825afdd-562a-4124-8375-6ada6b414caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:05.575442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825afdd-562a-4124-8375-6ada6b414caa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:05.575726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825afdd-562a-4124-8375-6ada6b414caa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:05.576026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c825afdd-562a-4124-8375-6ada6b414caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:05.576885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825afdd-562a-4124-8375-6ada6b414caa None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=7153a137b4734df1a057d26509d53dd3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:05.577198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825afdd-562a-4124-8375-6ada6b414caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:05.578764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c825afdd-562a-4124-8375-6ada6b414caa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:05.586867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 266/537] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:05 2022] GET /identity/v3/role_assignments?user.id=7153a137b4734df1a057d26509d53dd3&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:05.638731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b57389-1d80-4fa7-9d80-c07a6b90bf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:05.639417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b57389-1d80-4fa7-9d80-c07a6b90bf6a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:05.639704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b57389-1d80-4fa7-9d80-c07a6b90bf6a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:05.640006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b57389-1d80-4fa7-9d80-c07a6b90bf6a None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:05.641011 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b57389-1d80-4fa7-9d80-c07a6b90bf6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:05.641319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b57389-1d80-4fa7-9d80-c07a6b90bf6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:05.642752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b57389-1d80-4fa7-9d80-c07a6b90bf6a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:05.666199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 272/538] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:05.672756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825afdd-562a-4124-8375-6ada6b414caa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:05.800321 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c825afdd-562a-4124-8375-6ada6b414caa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:05.836196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925fb06-2be3-484f-ad97-6845fc6caf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:05.837053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925fb06-2be3-484f-ad97-6845fc6caf17 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:05.837394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925fb06-2be3-484f-ad97-6845fc6caf17 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:05.837673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5925fb06-2be3-484f-ad97-6845fc6caf17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:05.845778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925fb06-2be3-484f-ad97-6845fc6caf17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:05.847234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5925fb06-2be3-484f-ad97-6845fc6caf17 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:05.849125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5925fb06-2be3-484f-ad97-6845fc6caf17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:05.863334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:05.864228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:05.865107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:05.865107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:05.865107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:05.865107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:05.865107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:05.865107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:05.865107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:05.865107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:05.865107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 267/539] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:05.870901 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b57389-1d80-4fa7-9d80-c07a6b90bf6a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:05.880427 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:05.979775 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b57389-1d80-4fa7-9d80-c07a6b90bf6a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:06.017110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1eba9d-34d5-4b1f-9d23-3ba354fe8404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:06.017774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eba9d-34d5-4b1f-9d23-3ba354fe8404 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:06.018059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eba9d-34d5-4b1f-9d23-3ba354fe8404 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:06.018338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1eba9d-34d5-4b1f-9d23-3ba354fe8404 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:06.019132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eba9d-34d5-4b1f-9d23-3ba354fe8404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:06.019443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eba9d-34d5-4b1f-9d23-3ba354fe8404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:06.021096 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1eba9d-34d5-4b1f-9d23-3ba354fe8404 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:06.034512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 273/540] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:06.040504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925fb06-2be3-484f-ad97-6845fc6caf17 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:06.058293 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93b73-cb83-4e14-b002-22cbf00c2e5e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:06.058561 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93b73-cb83-4e14-b002-22cbf00c2e5e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:06.058845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d93b73-cb83-4e14-b002-22cbf00c2e5e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:06.060442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 274/541] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:06.067592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010172a-904f-48d5-b2b3-659dd69ecbfb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:06.067880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010172a-904f-48d5-b2b3-659dd69ecbfb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:06.068237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2010172a-904f-48d5-b2b3-659dd69ecbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:06.098957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2010172a-904f-48d5-b2b3-659dd69ecbfb None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:06.100209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2010172a-904f-48d5-b2b3-659dd69ecbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:06.199473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:06.207455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 275/542] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:50:06.214728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5925fb06-2be3-484f-ad97-6845fc6caf17 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:06.231654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010172a-904f-48d5-b2b3-659dd69ecbfb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:06.260691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8f6d6-4239-47de-a340-8966ee13716d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:06.262188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8f6d6-4239-47de-a340-8966ee13716d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:06.262573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8f6d6-4239-47de-a340-8966ee13716d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:06.262882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8f6d6-4239-47de-a340-8966ee13716d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:06.263684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8f6d6-4239-47de-a340-8966ee13716d None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=2ad07969d5a043e7b83e403da35120da) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:06.264011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8f6d6-4239-47de-a340-8966ee13716d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:06.266991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8f6d6-4239-47de-a340-8966ee13716d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:06.275533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 268/543] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:06 2022] GET /identity/v3/role_assignments?user.id=2ad07969d5a043e7b83e403da35120da&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:06.356962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2010172a-904f-48d5-b2b3-659dd69ecbfb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:06.401369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b06b0-90c3-4689-8348-111091ad5603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:06.402738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b06b0-90c3-4689-8348-111091ad5603 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:06.403025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b06b0-90c3-4689-8348-111091ad5603 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:06.403294 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b06b0-90c3-4689-8348-111091ad5603 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:06.415412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b06b0-90c3-4689-8348-111091ad5603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-270b06b0-90c3-4689-8348-111091ad5603 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:06.423705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:06.424691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:06.425716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 276/544] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:06.433650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8f6d6-4239-47de-a340-8966ee13716d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:06.534700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:06.577940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8f6d6-4239-47de-a340-8966ee13716d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:06.629699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f218ae64-7d16-4127-96be-7d0bd55717bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:06.630366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218ae64-7d16-4127-96be-7d0bd55717bf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:06.630648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218ae64-7d16-4127-96be-7d0bd55717bf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:06.630923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f218ae64-7d16-4127-96be-7d0bd55717bf None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:06.631787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218ae64-7d16-4127-96be-7d0bd55717bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:06.632121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218ae64-7d16-4127-96be-7d0bd55717bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:06.633523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f218ae64-7d16-4127-96be-7d0bd55717bf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:06.643662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 269/545] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:06.649628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b06b0-90c3-4689-8348-111091ad5603 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:06.749385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:06.805226 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b06b0-90c3-4689-8348-111091ad5603 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:06.854896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d690e-00a6-40c4-9f4c-47caf0360395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:06.855687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d690e-00a6-40c4-9f4c-47caf0360395 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:06.855990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d690e-00a6-40c4-9f4c-47caf0360395 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:06.856268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d690e-00a6-40c4-9f4c-47caf0360395 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:06.873543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d690e-00a6-40c4-9f4c-47caf0360395 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:06.875043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d690e-00a6-40c4-9f4c-47caf0360395 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:06.890007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419fda0-a765-4da8-acf5-9054cfa4460c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:06.890273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419fda0-a765-4da8-acf5-9054cfa4460c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:06.890792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e419fda0-a765-4da8-acf5-9054cfa4460c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:06.892465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 270/546] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2e3d690e-00a6-40c4-9f4c-47caf0360395 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:06.896396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:06.897296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:06.898134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:06.898134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:06.898134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:06.898134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:06.898134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 277/547] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:06.898890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7b227-469f-4aa3-99ee-05d6a9b38d62 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:06.898890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7b227-469f-4aa3-99ee-05d6a9b38d62 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:06.898890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7b227-469f-4aa3-99ee-05d6a9b38d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:06.914910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d690e-00a6-40c4-9f4c-47caf0360395 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:06.939974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7ca7b227-469f-4aa3-99ee-05d6a9b38d62 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:06.941548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7ca7b227-469f-4aa3-99ee-05d6a9b38d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:07.102090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 271/548] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:07.109870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d690e-00a6-40c4-9f4c-47caf0360395 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:07.119401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:07.137311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7b227-469f-4aa3-99ee-05d6a9b38d62 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:07.147705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaab8d4-b84c-4f2b-b97d-9ff29430275d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:07.148724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaab8d4-b84c-4f2b-b97d-9ff29430275d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:07.149315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaab8d4-b84c-4f2b-b97d-9ff29430275d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:07.149806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaab8d4-b84c-4f2b-b97d-9ff29430275d None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:07.150808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaab8d4-b84c-4f2b-b97d-9ff29430275d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:07.151320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaab8d4-b84c-4f2b-b97d-9ff29430275d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:07.153828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaab8d4-b84c-4f2b-b97d-9ff29430275d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:07.172445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 278/549] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:07.174752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaab8d4-b84c-4f2b-b97d-9ff29430275d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:07.283706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:07.337274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7b227-469f-4aa3-99ee-05d6a9b38d62 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:07.344262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaab8d4-b84c-4f2b-b97d-9ff29430275d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:07.395501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d309-cd41-485b-8722-be9c920d70d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:07.397348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d309-cd41-485b-8722-be9c920d70d4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:07.398213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d309-cd41-485b-8722-be9c920d70d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:07.398725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d309-cd41-485b-8722-be9c920d70d4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:07.407034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8d309-cd41-485b-8722-be9c920d70d4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:07.408804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8d309-cd41-485b-8722-be9c920d70d4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e0d8d309-cd41-485b-8722-be9c920d70d4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:07.425725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:07.426726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:07.427700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:07.427700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:07.427700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:07.427700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:07.427700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:07.427700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:07.427700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:07.427700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:07.427700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:07.427700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:07.435301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 279/550] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:07.436932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d309-cd41-485b-8722-be9c920d70d4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:07.453203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef5288-7afb-454a-ac94-64dd29002d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:07.454086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef5288-7afb-454a-ac94-64dd29002d70 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:07.454327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef5288-7afb-454a-ac94-64dd29002d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:07.454603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ef5288-7afb-454a-ac94-64dd29002d70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:07.472317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:07.496888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ef5288-7afb-454a-ac94-64dd29002d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-24ef5288-7afb-454a-ac94-64dd29002d70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:07.504767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:07.505938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:07.506812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:07.508459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 272/551] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:07.514179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef5288-7afb-454a-ac94-64dd29002d70 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:07.553906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d309-cd41-485b-8722-be9c920d70d4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:07.592169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758669-f220-48cf-9158-5016927e8e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:07.593241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758669-f220-48cf-9158-5016927e8e4a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:07.593721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758669-f220-48cf-9158-5016927e8e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:07.594207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b758669-f220-48cf-9158-5016927e8e4a None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:07.595277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b758669-f220-48cf-9158-5016927e8e4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:07.595792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b758669-f220-48cf-9158-5016927e8e4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:07.597890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b758669-f220-48cf-9158-5016927e8e4a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:07.623270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 280/552] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Jul 20 21:50:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:07.624867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758669-f220-48cf-9158-5016927e8e4a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:07.732467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:07.767201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b758669-f220-48cf-9158-5016927e8e4a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:07.784271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ef5288-7afb-454a-ac94-64dd29002d70 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:07.800278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:07.822408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9521b-1d25-4d2a-9a95-26ed09d44e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:07.823604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9521b-1d25-4d2a-9a95-26ed09d44e96 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:07.824106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9521b-1d25-4d2a-9a95-26ed09d44e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:07.824571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9521b-1d25-4d2a-9a95-26ed09d44e96 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:07.825339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9521b-1d25-4d2a-9a95-26ed09d44e96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:07.825652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9521b-1d25-4d2a-9a95-26ed09d44e96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:07.827063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9521b-1d25-4d2a-9a95-26ed09d44e96 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:07.836763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 273/553] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:07.844961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9521b-1d25-4d2a-9a95-26ed09d44e96 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:07.864645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907db864-e354-4c59-8a96-cd4168fdef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:07.865431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907db864-e354-4c59-8a96-cd4168fdef12 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:07.865703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907db864-e354-4c59-8a96-cd4168fdef12 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:07.865983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907db864-e354-4c59-8a96-cd4168fdef12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:07.989180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907db864-e354-4c59-8a96-cd4168fdef12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:07.991051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907db864-e354-4c59-8a96-cd4168fdef12 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:08.014278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9521b-1d25-4d2a-9a95-26ed09d44e96 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:08.053101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29443ff7-e455-4789-99b6-df64cc6dff14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:08.054159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29443ff7-e455-4789-99b6-df64cc6dff14 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.054638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29443ff7-e455-4789-99b6-df64cc6dff14 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.055098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29443ff7-e455-4789-99b6-df64cc6dff14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.067590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29443ff7-e455-4789-99b6-df64cc6dff14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:08.069669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29443ff7-e455-4789-99b6-df64cc6dff14 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-29443ff7-e455-4789-99b6-df64cc6dff14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:08.090780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:08.091875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:08.092883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:08.092883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:08.092883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:08.092883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:08.092883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 274/554] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:08.093318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fc7d7-b31e-4376-b6a4-fc690371d5c4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.093604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fc7d7-b31e-4376-b6a4-fc690371d5c4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.093878 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fc7d7-b31e-4376-b6a4-fc690371d5c4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.095515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 275/555] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:08.096196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e9799-8820-4a6e-9195-e3e432905648 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.096696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e9799-8820-4a6e-9195-e3e432905648 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.096696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e9799-8820-4a6e-9195-e3e432905648 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.098161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 276/556] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:08.103264 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de365dc-f8dd-4f91-acf4-3bffb21b3d5c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.103552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de365dc-f8dd-4f91-acf4-3bffb21b3d5c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.104093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de365dc-f8dd-4f91-acf4-3bffb21b3d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.107426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:08.121841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8de365dc-f8dd-4f91-acf4-3bffb21b3d5c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:08.123132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8de365dc-f8dd-4f91-acf4-3bffb21b3d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:08.128078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 281/557] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 20 21:50:08.128078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907db864-e354-4c59-8a96-cd4168fdef12 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:08.147649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:08.191788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 277/558] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:50:08.201357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b188f2e-bc6f-4075-bcf8-34c30cab5e12 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.201649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b188f2e-bc6f-4075-bcf8-34c30cab5e12 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.201956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b188f2e-bc6f-4075-bcf8-34c30cab5e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.223822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4b188f2e-bc6f-4075-bcf8-34c30cab5e12 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:08.225046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4b188f2e-bc6f-4075-bcf8-34c30cab5e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:08.239349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907db864-e354-4c59-8a96-cd4168fdef12 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:08.275957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e0b6e-b99a-4eaf-908c-2356ffce1473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:08.277296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e0b6e-b99a-4eaf-908c-2356ffce1473 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.277729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e0b6e-b99a-4eaf-908c-2356ffce1473 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.278058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e0b6e-b99a-4eaf-908c-2356ffce1473 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.278839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e0b6e-b99a-4eaf-908c-2356ffce1473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:08.279143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e0b6e-b99a-4eaf-908c-2356ffce1473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:08.280558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e0b6e-b99a-4eaf-908c-2356ffce1473 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:08.292829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 282/559] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:08.297897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e0b6e-b99a-4eaf-908c-2356ffce1473 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:08.308391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 278/560] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:08.308391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b188f2e-bc6f-4075-bcf8-34c30cab5e12 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:08.351337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:08.400998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:08.408213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e0b6e-b99a-4eaf-908c-2356ffce1473 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:08.413867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b188f2e-bc6f-4075-bcf8-34c30cab5e12 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:08.444133 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ba849-6c33-40bb-b631-2a5552a697a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:08.445083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ba849-6c33-40bb-b631-2a5552a697a9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.445663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ba849-6c33-40bb-b631-2a5552a697a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.445954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ba849-6c33-40bb-b631-2a5552a697a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.451121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7113ff-9b7c-43fd-ab04-e6bf26beb43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:08.451956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7113ff-9b7c-43fd-ab04-e6bf26beb43d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.455129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7113ff-9b7c-43fd-ab04-e6bf26beb43d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.455129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7113ff-9b7c-43fd-ab04-e6bf26beb43d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.458552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ba849-6c33-40bb-b631-2a5552a697a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:08.460125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ba849-6c33-40bb-b631-2a5552a697a9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:08.463444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7113ff-9b7c-43fd-ab04-e6bf26beb43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6a7113ff-9b7c-43fd-ab04-e6bf26beb43d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:08.471204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:08.472469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 279/561] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:08.478216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7113ff-9b7c-43fd-ab04-e6bf26beb43d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-474ba849-6c33-40bb-b631-2a5552a697a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:08.479646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:08.480670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:08.481592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:08.481592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:08.481592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:08.481592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:08.484075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 283/562] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:08.484910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ba849-6c33-40bb-b631-2a5552a697a9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:08.590926 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:08.594769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7113ff-9b7c-43fd-ab04-e6bf26beb43d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:08.595165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ba849-6c33-40bb-b631-2a5552a697a9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:08.629709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b282-5e97-4a0c-9295-fc784c00c207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:08.629943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983053d-dd1e-4dc0-beb1-b16105d4825e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:08.630498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b282-5e97-4a0c-9295-fc784c00c207 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.630687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983053d-dd1e-4dc0-beb1-b16105d4825e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.630793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b282-5e97-4a0c-9295-fc784c00c207 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.630971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983053d-dd1e-4dc0-beb1-b16105d4825e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.631077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248b282-5e97-4a0c-9295-fc784c00c207 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.631246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2983053d-dd1e-4dc0-beb1-b16105d4825e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.639147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248b282-5e97-4a0c-9295-fc784c00c207 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:08.640882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248b282-5e97-4a0c-9295-fc784c00c207 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:08.643416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2983053d-dd1e-4dc0-beb1-b16105d4825e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2983053d-dd1e-4dc0-beb1-b16105d4825e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:08.651601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:08.652920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:08.653776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2248b282-5e97-4a0c-9295-fc784c00c207 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:08.654976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:08.656150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 280/563] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:08.658426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b282-5e97-4a0c-9295-fc784c00c207 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:08.660726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 284/564] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:08.661821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983053d-dd1e-4dc0-beb1-b16105d4825e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:08.671097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:08.771654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2983053d-dd1e-4dc0-beb1-b16105d4825e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:08.772612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248b282-5e97-4a0c-9295-fc784c00c207 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:08.805768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d2eb3-87e2-4ba3-9285-3e286b05673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:08.806419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d2eb3-87e2-4ba3-9285-3e286b05673f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.806724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d2eb3-87e2-4ba3-9285-3e286b05673f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.806994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d2eb3-87e2-4ba3-9285-3e286b05673f None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.808453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d2eb3-87e2-4ba3-9285-3e286b05673f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:08.808776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d2eb3-87e2-4ba3-9285-3e286b05673f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:08.809033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d66f2-0b7c-4a0c-9b27-dbb722265c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:08.809693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d66f2-0b7c-4a0c-9b27-dbb722265c4e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.809974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d66f2-0b7c-4a0c-9b27-dbb722265c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.810246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343d66f2-0b7c-4a0c-9b27-dbb722265c4e None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.810336 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d2eb3-87e2-4ba3-9285-3e286b05673f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:08.810987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d66f2-0b7c-4a0c-9b27-dbb722265c4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:08.811291 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d66f2-0b7c-4a0c-9b27-dbb722265c4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:08.812671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343d66f2-0b7c-4a0c-9b27-dbb722265c4e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:08.820761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 281/565] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:08.821594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d66f2-0b7c-4a0c-9b27-dbb722265c4e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:08.827057 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 285/566] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:08.827057 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d2eb3-87e2-4ba3-9285-3e286b05673f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:08.842955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:08.892815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:08.923602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343d66f2-0b7c-4a0c-9b27-dbb722265c4e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:08.924265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d2eb3-87e2-4ba3-9285-3e286b05673f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:08.958904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4f7a2-d6f9-4f56-a752-d078965ef5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:08.959061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955e722-6de1-440d-975b-4d493fefbbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:08.959573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4f7a2-d6f9-4f56-a752-d078965ef5c3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.959659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e722-6de1-440d-975b-4d493fefbbbb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.959854 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4f7a2-d6f9-4f56-a752-d078965ef5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.959954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e722-6de1-440d-975b-4d493fefbbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.960182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4f7a2-d6f9-4f56-a752-d078965ef5c3 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.960271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955e722-6de1-440d-975b-4d493fefbbbb None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.960957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955e722-6de1-440d-975b-4d493fefbbbb None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:08.961033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4f7a2-d6f9-4f56-a752-d078965ef5c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:08.961265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955e722-6de1-440d-975b-4d493fefbbbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:08.961343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4f7a2-d6f9-4f56-a752-d078965ef5c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:08.962681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955e722-6de1-440d-975b-4d493fefbbbb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:08.962804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4f7a2-d6f9-4f56-a752-d078965ef5c3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:08.970933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 282/567] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:08.972209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bff5db-d05a-4f30-91a6-5a9015236e61 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:08.972497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bff5db-d05a-4f30-91a6-5a9015236e61 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:08.972771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bff5db-d05a-4f30-91a6-5a9015236e61 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:08.974077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 283/568] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:08.974766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bff5db-d05a-4f30-91a6-5a9015236e61 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:08.982115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 286/569] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:08.983131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4f7a2-d6f9-4f56-a752-d078965ef5c3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.061748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:09.080155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bff5db-d05a-4f30-91a6-5a9015236e61 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.084796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4f7a2-d6f9-4f56-a752-d078965ef5c3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.110518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:09.115248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c21474-ee3f-4aae-95aa-b723d60f667a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:09.116136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c21474-ee3f-4aae-95aa-b723d60f667a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.116419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c21474-ee3f-4aae-95aa-b723d60f667a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.116694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c21474-ee3f-4aae-95aa-b723d60f667a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.121166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387bc86-1509-4da0-bd69-9f66f3df3856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:09.121950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387bc86-1509-4da0-bd69-9f66f3df3856 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.122226 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387bc86-1509-4da0-bd69-9f66f3df3856 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.122493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1387bc86-1509-4da0-bd69-9f66f3df3856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.127774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c21474-ee3f-4aae-95aa-b723d60f667a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:09.129376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387bc86-1509-4da0-bd69-9f66f3df3856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:09.129524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c21474-ee3f-4aae-95aa-b723d60f667a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:09.130676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1387bc86-1509-4da0-bd69-9f66f3df3856 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1387bc86-1509-4da0-bd69-9f66f3df3856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:09.144380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:09.145270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:09.146166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:09.146166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:09.146166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:09.146166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:09.146166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:09.146166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:09.146166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:09.146166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:09.146166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 287/570] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:09.147345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387bc86-1509-4da0-bd69-9f66f3df3856 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-20c21474-ee3f-4aae-95aa-b723d60f667a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:09.147416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:09.148464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:09.149523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:09.149523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:09.149523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:09.149523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:09.149523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 284/571] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:09.149809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1c44-bf70-4495-b077-c22c89ba3f63 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.150544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1c44-bf70-4495-b077-c22c89ba3f63 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.150544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd1c44-bf70-4495-b077-c22c89ba3f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.168146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b2dd1c44-bf70-4495-b077-c22c89ba3f63 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:09.169442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b2dd1c44-bf70-4495-b077-c22c89ba3f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:09.237135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 285/572] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:09.238029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1c44-bf70-4495-b077-c22c89ba3f63 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.256989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1387bc86-1509-4da0-bd69-9f66f3df3856 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.293112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4a84e-b646-45d6-bac9-9ec077ccf8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:09.293906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a84e-b646-45d6-bac9-9ec077ccf8fd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.294186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a84e-b646-45d6-bac9-9ec077ccf8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.294462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4a84e-b646-45d6-bac9-9ec077ccf8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.297194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:09.305639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4a84e-b646-45d6-bac9-9ec077ccf8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:09.307064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a4a84e-b646-45d6-bac9-9ec077ccf8fd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-86a4a84e-b646-45d6-bac9-9ec077ccf8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:09.324167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:09.325233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:09.326172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:09.326172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:09.326172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:09.326172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:09.326172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 288/573] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:09.326449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4a84e-b646-45d6-bac9-9ec077ccf8fd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.342705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd1c44-bf70-4495-b077-c22c89ba3f63 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.357130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:09.376862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe1f6e-a84f-433b-943c-25b2cad99e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:09.377580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe1f6e-a84f-433b-943c-25b2cad99e8a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.377858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe1f6e-a84f-433b-943c-25b2cad99e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.378148 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbe1f6e-a84f-433b-943c-25b2cad99e8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.388441 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe1f6e-a84f-433b-943c-25b2cad99e8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:09.389891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbe1f6e-a84f-433b-943c-25b2cad99e8a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3bbe1f6e-a84f-433b-943c-25b2cad99e8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:09.408277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:09.409274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:09.410147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:09.410147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:09.410147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:09.410147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:09.410147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 286/574] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:09.410429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe1f6e-a84f-433b-943c-25b2cad99e8a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.434520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4a84e-b646-45d6-bac9-9ec077ccf8fd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.467631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904806ec-f498-43f5-b8ad-885cceb87262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:09.468314 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904806ec-f498-43f5-b8ad-885cceb87262 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.468603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904806ec-f498-43f5-b8ad-885cceb87262 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.468880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904806ec-f498-43f5-b8ad-885cceb87262 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.469709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904806ec-f498-43f5-b8ad-885cceb87262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:09.470022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904806ec-f498-43f5-b8ad-885cceb87262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:09.471487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904806ec-f498-43f5-b8ad-885cceb87262 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:09.484922 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 289/575] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:09.485727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904806ec-f498-43f5-b8ad-885cceb87262 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.508937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbe1f6e-a84f-433b-943c-25b2cad99e8a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.538043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:09.543367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2151-4a5d-409d-9ffb-6acfbb5f0118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:09.544064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2151-4a5d-409d-9ffb-6acfbb5f0118 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.544350 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2151-4a5d-409d-9ffb-6acfbb5f0118 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.544648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb2151-4a5d-409d-9ffb-6acfbb5f0118 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.545371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2151-4a5d-409d-9ffb-6acfbb5f0118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:09.545671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2151-4a5d-409d-9ffb-6acfbb5f0118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:09.547048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb2151-4a5d-409d-9ffb-6acfbb5f0118 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:09.558427 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 287/576] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:09.559262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2151-4a5d-409d-9ffb-6acfbb5f0118 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.588139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904806ec-f498-43f5-b8ad-885cceb87262 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.589773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:09.622281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7352d6-3e53-4d0e-8bd2-9e2a9a182803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:09.623099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7352d6-3e53-4d0e-8bd2-9e2a9a182803 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.623373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7352d6-3e53-4d0e-8bd2-9e2a9a182803 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.623638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7352d6-3e53-4d0e-8bd2-9e2a9a182803 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.633671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7352d6-3e53-4d0e-8bd2-9e2a9a182803 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bb7352d6-3e53-4d0e-8bd2-9e2a9a182803 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:09.641986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:09.643102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:09.644178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 290/577] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:09.645042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7352d6-3e53-4d0e-8bd2-9e2a9a182803 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.664990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb2151-4a5d-409d-9ffb-6acfbb5f0118 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.699256 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786e2e5-c43e-4054-94f4-8e72bab2ef96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:09.699901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786e2e5-c43e-4054-94f4-8e72bab2ef96 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.700204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786e2e5-c43e-4054-94f4-8e72bab2ef96 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.700470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6786e2e5-c43e-4054-94f4-8e72bab2ef96 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.701183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786e2e5-c43e-4054-94f4-8e72bab2ef96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:09.701483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786e2e5-c43e-4054-94f4-8e72bab2ef96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:09.702833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6786e2e5-c43e-4054-94f4-8e72bab2ef96 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:09.715106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 288/578] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:09.716008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786e2e5-c43e-4054-94f4-8e72bab2ef96 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.749929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7352d6-3e53-4d0e-8bd2-9e2a9a182803 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.758456 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:09.784351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e31485-8a5e-445e-8890-84d125a4abb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:09.785007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31485-8a5e-445e-8890-84d125a4abb6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.785319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31485-8a5e-445e-8890-84d125a4abb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.785985 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e31485-8a5e-445e-8890-84d125a4abb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.787086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31485-8a5e-445e-8890-84d125a4abb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:09.787688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31485-8a5e-445e-8890-84d125a4abb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:09.789115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e31485-8a5e-445e-8890-84d125a4abb6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:09.801509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 291/579] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:09.802310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e31485-8a5e-445e-8890-84d125a4abb6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.807344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:09.822413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6786e2e5-c43e-4054-94f4-8e72bab2ef96 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.903035 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5192fc1-c797-4a77-aee5-edbbc5c07da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:09.903604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5192fc1-c797-4a77-aee5-edbbc5c07da7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:09.903881 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5192fc1-c797-4a77-aee5-edbbc5c07da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:09.904194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5192fc1-c797-4a77-aee5-edbbc5c07da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:09.905016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5192fc1-c797-4a77-aee5-edbbc5c07da7 None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=dff5a11076ea426a8bf760bfee7a5023) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:09.905320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5192fc1-c797-4a77-aee5-edbbc5c07da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:09.906760 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5192fc1-c797-4a77-aee5-edbbc5c07da7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:09.912268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 289/580] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:09 2022] GET /identity/v3/role_assignments?user.id=dff5a11076ea426a8bf760bfee7a5023&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:09.913034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5192fc1-c797-4a77-aee5-edbbc5c07da7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:09.956607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e31485-8a5e-445e-8890-84d125a4abb6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:09.999890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0810b4d-7ecb-4154-8278-9c1c0c97541a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.000992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0810b4d-7ecb-4154-8278-9c1c0c97541a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.001438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0810b4d-7ecb-4154-8278-9c1c0c97541a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.001848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0810b4d-7ecb-4154-8278-9c1c0c97541a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.010526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0810b4d-7ecb-4154-8278-9c1c0c97541a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.012995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0810b4d-7ecb-4154-8278-9c1c0c97541a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d0810b4d-7ecb-4154-8278-9c1c0c97541a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:10.028715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:10.029935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 292/581] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:10.030905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0810b4d-7ecb-4154-8278-9c1c0c97541a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:10.037317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5192fc1-c797-4a77-aee5-edbbc5c07da7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.066943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:10.076978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ac59e-0fd9-4571-a9e2-6494f1c3336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.078177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ac59e-0fd9-4571-a9e2-6494f1c3336f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.078177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ac59e-0fd9-4571-a9e2-6494f1c3336f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.078177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ac59e-0fd9-4571-a9e2-6494f1c3336f None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.079080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ac59e-0fd9-4571-a9e2-6494f1c3336f None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:10.079394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ac59e-0fd9-4571-a9e2-6494f1c3336f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.084105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ac59e-0fd9-4571-a9e2-6494f1c3336f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.092543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 290/582] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:10.093376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ac59e-0fd9-4571-a9e2-6494f1c3336f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:10.110814 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:10.153381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0810b4d-7ecb-4154-8278-9c1c0c97541a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.192478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21526b1-9d77-4c03-9e35-f96d5c5a6543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.193273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21526b1-9d77-4c03-9e35-f96d5c5a6543 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.193549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21526b1-9d77-4c03-9e35-f96d5c5a6543 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.193825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21526b1-9d77-4c03-9e35-f96d5c5a6543 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.202130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21526b1-9d77-4c03-9e35-f96d5c5a6543 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.203575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21526b1-9d77-4c03-9e35-f96d5c5a6543 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.204665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ac59e-0fd9-4571-a9e2-6494f1c3336f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c21526b1-9d77-4c03-9e35-f96d5c5a6543 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:10.220939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:10.222127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:10.223264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:10.223264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:10.223264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:10.223264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:10.223264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:10.223264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:10.223264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:10.223264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:10.223264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 21:50:10.223264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:10.227046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 293/583] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:10.227912 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21526b1-9d77-4c03-9e35-f96d5c5a6543 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:10.243996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12a5b-fba2-42b6-9d41-42428dd0fcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.244957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a5b-fba2-42b6-9d41-42428dd0fcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.245364 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a5b-fba2-42b6-9d41-42428dd0fcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.246502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff12a5b-fba2-42b6-9d41-42428dd0fcf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.255696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff12a5b-fba2-42b6-9d41-42428dd0fcf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.257982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff12a5b-fba2-42b6-9d41-42428dd0fcf6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fff12a5b-fba2-42b6-9d41-42428dd0fcf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:10.274930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:10.275870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:10.277701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:10.277701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:10.277701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:10.277701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:10.277701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:10.277701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:10.277701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:10.277701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:10.277701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 291/584] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:10.278203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12a5b-fba2-42b6-9d41-42428dd0fcf6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:10.329748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:10.343249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21526b1-9d77-4c03-9e35-f96d5c5a6543 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.357375 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:10.386692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b0c27-b015-43ca-85ff-de176e8a4ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.386905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff12a5b-fba2-42b6-9d41-42428dd0fcf6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.387589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b0c27-b015-43ca-85ff-de176e8a4ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.388003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b0c27-b015-43ca-85ff-de176e8a4ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.388516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b0c27-b015-43ca-85ff-de176e8a4ba1 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.390259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b0c27-b015-43ca-85ff-de176e8a4ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:10.390955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b0c27-b015-43ca-85ff-de176e8a4ba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.392645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b0c27-b015-43ca-85ff-de176e8a4ba1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.412105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 294/585] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Jul 20 21:50:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:10.413159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b0c27-b015-43ca-85ff-de176e8a4ba1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:10.428884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1f5ab-e3cb-4ebd-a481-cfdc932b746a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.430279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1f5ab-e3cb-4ebd-a481-cfdc932b746a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.430704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1f5ab-e3cb-4ebd-a481-cfdc932b746a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.431176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1f5ab-e3cb-4ebd-a481-cfdc932b746a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.443099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1f5ab-e3cb-4ebd-a481-cfdc932b746a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.444793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d1f5ab-e3cb-4ebd-a481-cfdc932b746a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-89d1f5ab-e3cb-4ebd-a481-cfdc932b746a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:10.463266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:10.464478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:10.465599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:10.465599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:10.465599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:10.465599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:10.467137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 292/586] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:10.468061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1f5ab-e3cb-4ebd-a481-cfdc932b746a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:10.521380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b0c27-b015-43ca-85ff-de176e8a4ba1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.556940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dffa1a-ef33-485d-b7c3-addc5762f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.557606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dffa1a-ef33-485d-b7c3-addc5762f586 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.558427 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dffa1a-ef33-485d-b7c3-addc5762f586 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.558697 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dffa1a-ef33-485d-b7c3-addc5762f586 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.559687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dffa1a-ef33-485d-b7c3-addc5762f586 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:10.560017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dffa1a-ef33-485d-b7c3-addc5762f586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.561449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dffa1a-ef33-485d-b7c3-addc5762f586 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.578686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1f5ab-e3cb-4ebd-a481-cfdc932b746a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.579235 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 295/587] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Jul 20 21:50:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:10.580064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dffa1a-ef33-485d-b7c3-addc5762f586 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:10.586781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:10.612680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:10.627179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c022-c7d7-4ba3-8276-0d7b6750c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.627970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c022-c7d7-4ba3-8276-0d7b6750c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.628668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c022-c7d7-4ba3-8276-0d7b6750c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.629008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5036c022-c7d7-4ba3-8276-0d7b6750c1f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.630136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036c022-c7d7-4ba3-8276-0d7b6750c1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:10.630557 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036c022-c7d7-4ba3-8276-0d7b6750c1f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.632621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5036c022-c7d7-4ba3-8276-0d7b6750c1f3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.650178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 293/588] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:10.651132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c022-c7d7-4ba3-8276-0d7b6750c1f3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:10.694521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dffa1a-ef33-485d-b7c3-addc5762f586 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.732084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c987b4-8410-4acb-89af-c3038a37c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.732947 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c987b4-8410-4acb-89af-c3038a37c1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.733212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c987b4-8410-4acb-89af-c3038a37c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.733494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c987b4-8410-4acb-89af-c3038a37c1d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.743667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c987b4-8410-4acb-89af-c3038a37c1d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.745703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c987b4-8410-4acb-89af-c3038a37c1d1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.762283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5036c022-c7d7-4ba3-8276-0d7b6750c1f3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e4c987b4-8410-4acb-89af-c3038a37c1d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:10.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:10.765097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:10.766243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:10.766243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:10.766243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:10.766243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:10.766243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 296/589] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:10.767753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c987b4-8410-4acb-89af-c3038a37c1d1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:10.804908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57152cd2-428d-4597-80b6-79cfc87eaa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.805577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152cd2-428d-4597-80b6-79cfc87eaa75 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.808964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152cd2-428d-4597-80b6-79cfc87eaa75 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.808964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57152cd2-428d-4597-80b6-79cfc87eaa75 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.808964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57152cd2-428d-4597-80b6-79cfc87eaa75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:10.808964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57152cd2-428d-4597-80b6-79cfc87eaa75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.809284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57152cd2-428d-4597-80b6-79cfc87eaa75 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.821835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 294/590] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:10.822882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57152cd2-428d-4597-80b6-79cfc87eaa75 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:10.836101 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:10.895033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:10.913572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c987b4-8410-4acb-89af-c3038a37c1d1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.955113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98018348-f0c4-4dfb-bac3-c0a2f90671fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:10.955900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98018348-f0c4-4dfb-bac3-c0a2f90671fb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:10.956207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98018348-f0c4-4dfb-bac3-c0a2f90671fb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:10.956310 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57152cd2-428d-4597-80b6-79cfc87eaa75 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:10.956477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98018348-f0c4-4dfb-bac3-c0a2f90671fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:10.969303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98018348-f0c4-4dfb-bac3-c0a2f90671fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:10.970946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98018348-f0c4-4dfb-bac3-c0a2f90671fb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-98018348-f0c4-4dfb-bac3-c0a2f90671fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:10.989935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:10.991069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:10.992225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:10.992225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:10.992225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:10.992225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:10.992950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 297/591] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:10.993567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98018348-f0c4-4dfb-bac3-c0a2f90671fb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.000163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c0cba-23a4-40f2-b945-1db2599fa9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:11.001274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c0cba-23a4-40f2-b945-1db2599fa9dd None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:11.001524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c0cba-23a4-40f2-b945-1db2599fa9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:11.001890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c0cba-23a4-40f2-b945-1db2599fa9dd None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/5e192a50b09b49b4b7db2508ecf75af5/roles/917334e4be884c77a974784c424ccde3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:11.019808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c0cba-23a4-40f2-b945-1db2599fa9dd None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=5e192a50b09b49b4b7db2508ecf75af5, role_id=917334e4be884c77a974784c424ccde3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:11.021928 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65c0cba-23a4-40f2-b945-1db2599fa9dd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:11.097116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98018348-f0c4-4dfb-bac3-c0a2f90671fb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:11.106507 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:11.119945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 295/592] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:50:10 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/5e192a50b09b49b4b7db2508ecf75af5/roles/917334e4be884c77a974784c424ccde3 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:50:11.119945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c0cba-23a4-40f2-b945-1db2599fa9dd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.146381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af7558-82e9-4b56-88d6-ceec9700f18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:11.147157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af7558-82e9-4b56-88d6-ceec9700f18f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:11.147572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af7558-82e9-4b56-88d6-ceec9700f18f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:11.148223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af7558-82e9-4b56-88d6-ceec9700f18f None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:11.149589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af7558-82e9-4b56-88d6-ceec9700f18f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:11.149969 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af7558-82e9-4b56-88d6-ceec9700f18f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:11.152386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af7558-82e9-4b56-88d6-ceec9700f18f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:11.168895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 298/593] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:11.169792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af7558-82e9-4b56-88d6-ceec9700f18f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.242222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:11.250927 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c0cba-23a4-40f2-b945-1db2599fa9dd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:11.300365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ebd8e-22ae-4eee-a76e-6c6623fe142e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:11.301175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ebd8e-22ae-4eee-a76e-6c6623fe142e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:11.301868 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ebd8e-22ae-4eee-a76e-6c6623fe142e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:11.301868 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5ebd8e-22ae-4eee-a76e-6c6623fe142e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:11.312982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ebd8e-22ae-4eee-a76e-6c6623fe142e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:11.315202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5ebd8e-22ae-4eee-a76e-6c6623fe142e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:11.315854 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af7558-82e9-4b56-88d6-ceec9700f18f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fc5ebd8e-22ae-4eee-a76e-6c6623fe142e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:11.334720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:11.335856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:11.337039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:11.337039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:11.337039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:11.337039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:11.337039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:11.337039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:11.337039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:11.337039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:11.337039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 21:50:11.337039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:11.344087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 296/594] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:11.344087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ebd8e-22ae-4eee-a76e-6c6623fe142e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.365065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bf0ab-d507-4c4c-b6a4-14784f2f9ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:11.365868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf0ab-d507-4c4c-b6a4-14784f2f9ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:11.366779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf0ab-d507-4c4c-b6a4-14784f2f9ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:11.367162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04bf0ab-d507-4c4c-b6a4-14784f2f9ea2 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:11.368299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bf0ab-d507-4c4c-b6a4-14784f2f9ea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:11.368708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bf0ab-d507-4c4c-b6a4-14784f2f9ea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:11.371736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04bf0ab-d507-4c4c-b6a4-14784f2f9ea2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:11.391900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 299/595] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:11.392796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bf0ab-d507-4c4c-b6a4-14784f2f9ea2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.423778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:11.462917 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5ebd8e-22ae-4eee-a76e-6c6623fe142e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:11.499128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7d156-0767-4567-860f-3eac536ebeff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:11.499961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7d156-0767-4567-860f-3eac536ebeff None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:11.500260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7d156-0767-4567-860f-3eac536ebeff None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:11.500530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7d156-0767-4567-860f-3eac536ebeff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:11.508183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7d156-0767-4567-860f-3eac536ebeff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:11.509666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7d156-0767-4567-860f-3eac536ebeff None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:11.524373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04bf0ab-d507-4c4c-b6a4-14784f2f9ea2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8fb7d156-0767-4567-860f-3eac536ebeff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:11.525040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:11.526080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:11.527190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:11.527190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:11.527190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:11.527190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:11.527190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:11.527190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:11.527190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:11.527190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:11.527190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 297/596] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:11.527824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7d156-0767-4567-860f-3eac536ebeff None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.545124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:11.570112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f92fc-c616-4e28-95ab-53fadad9de6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:11.570930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f92fc-c616-4e28-95ab-53fadad9de6b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:11.571272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f92fc-c616-4e28-95ab-53fadad9de6b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:11.571647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5f92fc-c616-4e28-95ab-53fadad9de6b None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:11.572604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f92fc-c616-4e28-95ab-53fadad9de6b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:11.572971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f92fc-c616-4e28-95ab-53fadad9de6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:11.575284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5f92fc-c616-4e28-95ab-53fadad9de6b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:11.599316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 300/597] 10.222.0.85 () {56 vars in 1139 bytes} [Wed Jul 20 21:50:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:11.600439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f92fc-c616-4e28-95ab-53fadad9de6b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.658989 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7d156-0767-4567-860f-3eac536ebeff None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:11.694190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:11.708848 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb578-1459-4394-af7c-95e1fdab246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:11.720470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb578-1459-4394-af7c-95e1fdab246a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:11.720470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb578-1459-4394-af7c-95e1fdab246a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:11.720662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5f92fc-c616-4e28-95ab-53fadad9de6b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:11.720742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739fb578-1459-4394-af7c-95e1fdab246a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:11.720742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb578-1459-4394-af7c-95e1fdab246a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:11.720742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739fb578-1459-4394-af7c-95e1fdab246a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-739fb578-1459-4394-af7c-95e1fdab246a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:11.738515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:11.739429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:11.740465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:11.740465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:11.740465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:11.740465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:11.740465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:11.740465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:11.740465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:11.740465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:11.744413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 298/598] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:11.746094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb578-1459-4394-af7c-95e1fdab246a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.754672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7518227-cdde-4256-a51a-5ffbfb525b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:11.756181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7518227-cdde-4256-a51a-5ffbfb525b24 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:11.756693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7518227-cdde-4256-a51a-5ffbfb525b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:11.757168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7518227-cdde-4256-a51a-5ffbfb525b24 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:11.758575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7518227-cdde-4256-a51a-5ffbfb525b24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:11.759491 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7518227-cdde-4256-a51a-5ffbfb525b24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:11.761538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7518227-cdde-4256-a51a-5ffbfb525b24 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:11.779726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 301/599] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:11.781142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7518227-cdde-4256-a51a-5ffbfb525b24 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.829819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:11.865455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739fb578-1459-4394-af7c-95e1fdab246a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:11.911543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7518227-cdde-4256-a51a-5ffbfb525b24 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:11.916130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adee86-5029-4215-9ea3-5c056e0bce58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:11.917306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adee86-5029-4215-9ea3-5c056e0bce58 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:11.917800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adee86-5029-4215-9ea3-5c056e0bce58 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:11.918274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4adee86-5029-4215-9ea3-5c056e0bce58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:11.933775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adee86-5029-4215-9ea3-5c056e0bce58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:11.936178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4adee86-5029-4215-9ea3-5c056e0bce58 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:11.958466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff030ff-2ea2-4395-80e5-f7534a91c8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:11.959415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff030ff-2ea2-4395-80e5-f7534a91c8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:11.959898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff030ff-2ea2-4395-80e5-f7534a91c8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:11.960445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff030ff-2ea2-4395-80e5-f7534a91c8e3 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:11.961438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff030ff-2ea2-4395-80e5-f7534a91c8e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:11.961945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff030ff-2ea2-4395-80e5-f7534a91c8e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:11.963697 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff030ff-2ea2-4395-80e5-f7534a91c8e3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a4adee86-5029-4215-9ea3-5c056e0bce58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:11.967622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:11.968540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:11.969453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:11.969453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:11.969453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:11.969453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:11.973164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 299/600] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:11.974062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adee86-5029-4215-9ea3-5c056e0bce58 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.983734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 302/601] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:11.984888 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff030ff-2ea2-4395-80e5-f7534a91c8e3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:11.996272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:12.086658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4adee86-5029-4215-9ea3-5c056e0bce58 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:12.101894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff030ff-2ea2-4395-80e5-f7534a91c8e3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:12.114047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:12.124381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9c7b5-7c0a-47c1-a132-aa824c641284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:12.125541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9c7b5-7c0a-47c1-a132-aa824c641284 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:12.125822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9c7b5-7c0a-47c1-a132-aa824c641284 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:12.126093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9c7b5-7c0a-47c1-a132-aa824c641284 None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/7153a137b4734df1a057d26509d53dd3/roles/917334e4be884c77a974784c424ccde3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:12.138879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7645bf4-83bb-48f3-b65f-089da41abf52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:12.139617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7645bf4-83bb-48f3-b65f-089da41abf52 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:12.139990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7645bf4-83bb-48f3-b65f-089da41abf52 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:12.140331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7645bf4-83bb-48f3-b65f-089da41abf52 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:12.141370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7645bf4-83bb-48f3-b65f-089da41abf52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:12.141744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7645bf4-83bb-48f3-b65f-089da41abf52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:12.143206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7645bf4-83bb-48f3-b65f-089da41abf52 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:12.144988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9c7b5-7c0a-47c1-a132-aa824c641284 None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=7153a137b4734df1a057d26509d53dd3, role_id=917334e4be884c77a974784c424ccde3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:12.147067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9c7b5-7c0a-47c1-a132-aa824c641284 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:12.155299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 303/602] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:12.156178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7645bf4-83bb-48f3-b65f-089da41abf52 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:12.222071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:12.237897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 300/603] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:50:11 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/7153a137b4734df1a057d26509d53dd3/roles/917334e4be884c77a974784c424ccde3 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:50:12.239350 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc008c4-31f0-4fdc-8fe0-ce1a07f0a4a6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:12.239642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc008c4-31f0-4fdc-8fe0-ce1a07f0a4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:12.239940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc008c4-31f0-4fdc-8fe0-ce1a07f0a4a6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:12.241344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 301/604] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:12.244990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc008c4-31f0-4fdc-8fe0-ce1a07f0a4a6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:12.269042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7645bf4-83bb-48f3-b65f-089da41abf52 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:12.316949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e23241-b017-4dff-9023-f936682148ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:12.318189 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23241-b017-4dff-9023-f936682148ae None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:12.318765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23241-b017-4dff-9023-f936682148ae None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:12.319203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e23241-b017-4dff-9023-f936682148ae None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/2169b05e64224f69bcc1d9ce912a60e1/roles/917334e4be884c77a974784c424ccde3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:12.337985 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e23241-b017-4dff-9023-f936682148ae None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=2169b05e64224f69bcc1d9ce912a60e1, role_id=917334e4be884c77a974784c424ccde3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:12.339774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e23241-b017-4dff-9023-f936682148ae None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:12.383736 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc008c4-31f0-4fdc-8fe0-ce1a07f0a4a6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:12.425933 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 304/605] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:50:12 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/2169b05e64224f69bcc1d9ce912a60e1/roles/917334e4be884c77a974784c424ccde3 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:50:12.427888 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc740f-7442-4c22-8b11-e4037965a300 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:12.428886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc740f-7442-4c22-8b11-e4037965a300 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:12.429734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc740f-7442-4c22-8b11-e4037965a300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:12.433454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb29f61-4b55-49e1-9f4a-477a238c7e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:12.434387 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb29f61-4b55-49e1-9f4a-477a238c7e31 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:12.434802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb29f61-4b55-49e1-9f4a-477a238c7e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:12.435141 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb29f61-4b55-49e1-9f4a-477a238c7e31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:12.445530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb29f61-4b55-49e1-9f4a-477a238c7e31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:12.447419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb29f61-4b55-49e1-9f4a-477a238c7e31 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:12.458747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-18fc740f-7442-4c22-8b11-e4037965a300 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:12.460205 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-18fc740f-7442-4c22-8b11-e4037965a300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5bb29f61-4b55-49e1-9f4a-477a238c7e31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:12.466787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:12.468260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:12.469351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:12.469351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:12.469351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:12.469351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:12.469351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:12.469351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:12.469351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:12.469351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:12.473216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 302/606] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:12.479025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb29f61-4b55-49e1-9f4a-477a238c7e31 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:12.534368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:12.609106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb29f61-4b55-49e1-9f4a-477a238c7e31 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:12.628765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 305/607] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:12.652370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc740f-7442-4c22-8b11-e4037965a300 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:12.664140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d62add-6d4b-46df-b50b-fc138f802fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:12.665004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d62add-6d4b-46df-b50b-fc138f802fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:12.665382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d62add-6d4b-46df-b50b-fc138f802fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:12.665791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d62add-6d4b-46df-b50b-fc138f802fc5 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:12.666592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d62add-6d4b-46df-b50b-fc138f802fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:12.666904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d62add-6d4b-46df-b50b-fc138f802fc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:12.669748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d62add-6d4b-46df-b50b-fc138f802fc5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:12.684497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 303/608] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:12.690562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d62add-6d4b-46df-b50b-fc138f802fc5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:12.709819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:12.825473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:12.831761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d62add-6d4b-46df-b50b-fc138f802fc5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:12.835786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc740f-7442-4c22-8b11-e4037965a300 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:12.869626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8947cd2-d3f6-4bd9-a3c5-e0718794bb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:12.871070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8947cd2-d3f6-4bd9-a3c5-e0718794bb47 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:12.871351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8947cd2-d3f6-4bd9-a3c5-e0718794bb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:12.871624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8947cd2-d3f6-4bd9-a3c5-e0718794bb47 None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/2ad07969d5a043e7b83e403da35120da/roles/917334e4be884c77a974784c424ccde3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:12.886958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8947cd2-d3f6-4bd9-a3c5-e0718794bb47 None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=2ad07969d5a043e7b83e403da35120da, role_id=917334e4be884c77a974784c424ccde3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:12.888512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8947cd2-d3f6-4bd9-a3c5-e0718794bb47 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:12.909955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427d2c2-1285-450b-aee1-027ea3234d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:12.910766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427d2c2-1285-450b-aee1-027ea3234d9b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:12.911051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427d2c2-1285-450b-aee1-027ea3234d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:12.911328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9427d2c2-1285-450b-aee1-027ea3234d9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:12.923845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9427d2c2-1285-450b-aee1-027ea3234d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9427d2c2-1285-450b-aee1-027ea3234d9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:12.931717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:12.932812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:12.933706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:12.934348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 306/609] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:12.940903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427d2c2-1285-450b-aee1-027ea3234d9b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:12.957025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 304/610] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:50:12 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/2ad07969d5a043e7b83e403da35120da/roles/917334e4be884c77a974784c424ccde3 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:50:13.094861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9427d2c2-1285-450b-aee1-027ea3234d9b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:13.108063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:13.142771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6de7f-05c1-4b5c-a9a1-20fec473af49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:13.143369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6de7f-05c1-4b5c-a9a1-20fec473af49 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:13.143651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6de7f-05c1-4b5c-a9a1-20fec473af49 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:13.143944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6de7f-05c1-4b5c-a9a1-20fec473af49 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:13.144915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6de7f-05c1-4b5c-a9a1-20fec473af49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:13.145308 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6de7f-05c1-4b5c-a9a1-20fec473af49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:13.146686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6de7f-05c1-4b5c-a9a1-20fec473af49 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:13.161462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 307/611] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:13.168049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8947cd2-d3f6-4bd9-a3c5-e0718794bb47 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:13.303511 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8947cd2-d3f6-4bd9-a3c5-e0718794bb47 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:13.346527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb03f99-3d2f-4086-ad50-343d90a2ffad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:13.347487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb03f99-3d2f-4086-ad50-343d90a2ffad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:13.347865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb03f99-3d2f-4086-ad50-343d90a2ffad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:13.348297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb03f99-3d2f-4086-ad50-343d90a2ffad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:13.359884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb03f99-3d2f-4086-ad50-343d90a2ffad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:13.361503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb03f99-3d2f-4086-ad50-343d90a2ffad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:13.388369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0eb03f99-3d2f-4086-ad50-343d90a2ffad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:13.390272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:13.391563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:13.392687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:13.392687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:13.392687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:13.392687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:13.394620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 305/612] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:13.399953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e403d6-ad47-4e70-8492-dd13072c11e8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:13.400104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb03f99-3d2f-4086-ad50-343d90a2ffad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:13.404267 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e403d6-ad47-4e70-8492-dd13072c11e8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:13.404267 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e403d6-ad47-4e70-8492-dd13072c11e8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:13.404267 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 308/613] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:13.408807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360333-6e08-4944-a38b-60dae925de9d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:13.409272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360333-6e08-4944-a38b-60dae925de9d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:13.409711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5360333-6e08-4944-a38b-60dae925de9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:13.453351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e5360333-6e08-4944-a38b-60dae925de9d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:13.454352 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e5360333-6e08-4944-a38b-60dae925de9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:13.562070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb03f99-3d2f-4086-ad50-343d90a2ffad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:13.592366 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 309/614] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:50:13.613238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8488f6-7952-4a22-a035-c607491c8863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:13.613927 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8488f6-7952-4a22-a035-c607491c8863 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:13.614210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8488f6-7952-4a22-a035-c607491c8863 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:13.614489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8488f6-7952-4a22-a035-c607491c8863 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:13.615233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8488f6-7952-4a22-a035-c607491c8863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:13.615549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8488f6-7952-4a22-a035-c607491c8863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:13.616969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8488f6-7952-4a22-a035-c607491c8863 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:13.617536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5360333-6e08-4944-a38b-60dae925de9d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:13.631403 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 306/615] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:13.637906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8488f6-7952-4a22-a035-c607491c8863 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:13.732414 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:13.811502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8488f6-7952-4a22-a035-c607491c8863 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:13.812921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:13.818193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5360333-6e08-4944-a38b-60dae925de9d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:13.855337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94d6c0-1791-4299-a3c0-6cf331826e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:13.856418 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94d6c0-1791-4299-a3c0-6cf331826e8a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:13.856979 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94d6c0-1791-4299-a3c0-6cf331826e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:13.857392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94d6c0-1791-4299-a3c0-6cf331826e8a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:13.870667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba94d6c0-1791-4299-a3c0-6cf331826e8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:13.873971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dabe1-7316-44bf-b6f9-18a79167194a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:13.874770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dabe1-7316-44bf-b6f9-18a79167194a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:13.875055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dabe1-7316-44bf-b6f9-18a79167194a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:13.875330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dabe1-7316-44bf-b6f9-18a79167194a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ba94d6c0-1791-4299-a3c0-6cf331826e8a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:13.879776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:13.880897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:13.881910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:13.889777 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 310/616] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:13.891447 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94d6c0-1791-4299-a3c0-6cf331826e8a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:13.892232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dabe1-7316-44bf-b6f9-18a79167194a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:13.893694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dabe1-7316-44bf-b6f9-18a79167194a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e48dabe1-7316-44bf-b6f9-18a79167194a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:13.919635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:13.920815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:13.921842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 307/617] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:13.928804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dabe1-7316-44bf-b6f9-18a79167194a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:14.015346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94d6c0-1791-4299-a3c0-6cf331826e8a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:14.050552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d54e1c-9036-423c-bed9-c3d0c0893779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:14.051400 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d54e1c-9036-423c-bed9-c3d0c0893779 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:14.051784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d54e1c-9036-423c-bed9-c3d0c0893779 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:14.052182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d54e1c-9036-423c-bed9-c3d0c0893779 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:14.053032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d54e1c-9036-423c-bed9-c3d0c0893779 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:14.053505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d54e1c-9036-423c-bed9-c3d0c0893779 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:14.054954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d54e1c-9036-423c-bed9-c3d0c0893779 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:14.064917 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 311/618] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:14.071402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d54e1c-9036-423c-bed9-c3d0c0893779 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:14.104099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:14.162232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dabe1-7316-44bf-b6f9-18a79167194a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:14.190266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d54e1c-9036-423c-bed9-c3d0c0893779 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:14.192668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:14.231567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eed761-4f60-48f9-aed0-df84e693795d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:14.232422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eed761-4f60-48f9-aed0-df84e693795d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:14.232806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eed761-4f60-48f9-aed0-df84e693795d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:14.233209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eed761-4f60-48f9-aed0-df84e693795d None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:14.234155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eed761-4f60-48f9-aed0-df84e693795d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:14.235705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eed761-4f60-48f9-aed0-df84e693795d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:14.237265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eed761-4f60-48f9-aed0-df84e693795d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:14.258716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4112177-d823-4e0d-919b-a3581ec7b712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:14.259674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112177-d823-4e0d-919b-a3581ec7b712 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:14.260079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112177-d823-4e0d-919b-a3581ec7b712 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:14.260451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112177-d823-4e0d-919b-a3581ec7b712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:14.275107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 308/619] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Jul 20 21:50:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:14.276561 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4112177-d823-4e0d-919b-a3581ec7b712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:14.278184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4112177-d823-4e0d-919b-a3581ec7b712 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:14.280207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eed761-4f60-48f9-aed0-df84e693795d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f4112177-d823-4e0d-919b-a3581ec7b712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:14.313089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:14.314037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:14.315074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:14.315074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:14.315074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:14.315074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:14.315074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 312/620] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:14.321024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4112177-d823-4e0d-919b-a3581ec7b712 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:14.457089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:14.461339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4112177-d823-4e0d-919b-a3581ec7b712 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:14.465084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eed761-4f60-48f9-aed0-df84e693795d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:14.496655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53b7cf-4889-47d5-badf-5fae07c80448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:14.497316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53b7cf-4889-47d5-badf-5fae07c80448 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:14.497590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53b7cf-4889-47d5-badf-5fae07c80448 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:14.497860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53b7cf-4889-47d5-badf-5fae07c80448 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:14.498583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53b7cf-4889-47d5-badf-5fae07c80448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:14.498891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53b7cf-4889-47d5-badf-5fae07c80448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:14.500400 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53b7cf-4889-47d5-badf-5fae07c80448 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:14.502012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89f31-fe43-4522-bb17-9b90175bfd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:14.502929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89f31-fe43-4522-bb17-9b90175bfd20 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:14.503316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89f31-fe43-4522-bb17-9b90175bfd20 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:14.503701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a89f31-fe43-4522-bb17-9b90175bfd20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:14.512787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 313/621] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:14.519414 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a89f31-fe43-4522-bb17-9b90175bfd20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:14.519561 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53b7cf-4889-47d5-badf-5fae07c80448 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:14.520849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a89f31-fe43-4522-bb17-9b90175bfd20 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a3a89f31-fe43-4522-bb17-9b90175bfd20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:14.552373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:14.553315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:14.554222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:14.554222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:14.554222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:14.554222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:14.554457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 309/622] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:14.560265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89f31-fe43-4522-bb17-9b90175bfd20 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:14.593594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:14.676486 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a89f31-fe43-4522-bb17-9b90175bfd20 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:14.747855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087e65f-9467-4bcc-a6ae-cc0677f9fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:14.748517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087e65f-9467-4bcc-a6ae-cc0677f9fe2c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:14.748802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087e65f-9467-4bcc-a6ae-cc0677f9fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:14.749075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087e65f-9467-4bcc-a6ae-cc0677f9fe2c None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:14.749799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087e65f-9467-4bcc-a6ae-cc0677f9fe2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:14.750103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087e65f-9467-4bcc-a6ae-cc0677f9fe2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:14.751472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087e65f-9467-4bcc-a6ae-cc0677f9fe2c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:14.782498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 310/623] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:14.784684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53b7cf-4889-47d5-badf-5fae07c80448 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:14.786924 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087e65f-9467-4bcc-a6ae-cc0677f9fe2c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:14.840405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:14.845932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ab281e-8988-4f83-896d-809d3e146431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:14.846715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab281e-8988-4f83-896d-809d3e146431 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:14.846993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab281e-8988-4f83-896d-809d3e146431 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:14.847332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab281e-8988-4f83-896d-809d3e146431 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:14.855287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab281e-8988-4f83-896d-809d3e146431 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:14.856942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ab281e-8988-4f83-896d-809d3e146431 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c0ab281e-8988-4f83-896d-809d3e146431 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:14.873058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:14.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:14.875304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 314/624] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Jul 20 21:50:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:14.875913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78b0d7-c154-46dc-ace8-49a85ebe1e77 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:14.876048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78b0d7-c154-46dc-ace8-49a85ebe1e77 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:14.876284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78b0d7-c154-46dc-ace8-49a85ebe1e77 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:14.877676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 315/625] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:14.882316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78b0d7-c154-46dc-ace8-49a85ebe1e77 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:14.909289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:14.921419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087e65f-9467-4bcc-a6ae-cc0677f9fe2c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:14.965250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fe687-232a-41c0-bac6-7181ab58e6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:14.966048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fe687-232a-41c0-bac6-7181ab58e6ef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:14.966325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fe687-232a-41c0-bac6-7181ab58e6ef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:14.966601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fe687-232a-41c0-bac6-7181ab58e6ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:14.973557 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fe687-232a-41c0-bac6-7181ab58e6ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:14.975000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fe687-232a-41c0-bac6-7181ab58e6ef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8a2fe687-232a-41c0-bac6-7181ab58e6ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:14.989231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:14.990179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:14.991066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:14.991066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:14.991066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:14.991066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:14.991066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:14.991066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:14.991066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:14.991066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:14.991066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 311/626] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:14.993085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf71b-d2e5-4cba-b30a-5f2e295ca124 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:14.993085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf71b-d2e5-4cba-b30a-5f2e295ca124 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:14.993085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecf71b-d2e5-4cba-b30a-5f2e295ca124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.006649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78b0d7-c154-46dc-ace8-49a85ebe1e77 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:15.010172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f8ecf71b-d2e5-4cba-b30a-5f2e295ca124 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:15.011862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f8ecf71b-d2e5-4cba-b30a-5f2e295ca124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:15.044990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f124b-dfd4-4025-bc14-3f7e0c3ebf23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:15.045652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f124b-dfd4-4025-bc14-3f7e0c3ebf23 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.045931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f124b-dfd4-4025-bc14-3f7e0c3ebf23 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.046201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f124b-dfd4-4025-bc14-3f7e0c3ebf23 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.047028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f124b-dfd4-4025-bc14-3f7e0c3ebf23 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:15.047333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f124b-dfd4-4025-bc14-3f7e0c3ebf23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:15.048821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f124b-dfd4-4025-bc14-3f7e0c3ebf23 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:15.065983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 316/627] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Jul 20 21:50:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:15.067654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd066-2374-401f-b81d-5ff8c7a66284 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.067959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd066-2374-401f-b81d-5ff8c7a66284 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.068237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd066-2374-401f-b81d-5ff8c7a66284 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.072141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 317/628] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:15.072141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cd066-2374-401f-b81d-5ff8c7a66284 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:15.104009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 312/629] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:15.104009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecf71b-d2e5-4cba-b30a-5f2e295ca124 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:15.143363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:15.187662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:15.200185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cd066-2374-401f-b81d-5ff8c7a66284 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:15.216565 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecf71b-d2e5-4cba-b30a-5f2e295ca124 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:15.236489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa67b11-9e4a-49e8-a82e-849ebc590a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:15.237151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa67b11-9e4a-49e8-a82e-849ebc590a66 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.237421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa67b11-9e4a-49e8-a82e-849ebc590a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.237694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa67b11-9e4a-49e8-a82e-849ebc590a66 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.238476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa67b11-9e4a-49e8-a82e-849ebc590a66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:15.238779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa67b11-9e4a-49e8-a82e-849ebc590a66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:15.240219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa67b11-9e4a-49e8-a82e-849ebc590a66 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:15.251483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 318/630] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:15.252785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c666-1f43-4a7e-b53e-c7ca0952ae0b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.253071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c666-1f43-4a7e-b53e-c7ca0952ae0b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.253524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944c666-1f43-4a7e-b53e-c7ca0952ae0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.262734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d84085-b821-42f1-b3ae-2bcb70a821f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:15.263616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d84085-b821-42f1-b3ae-2bcb70a821f2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.264084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d84085-b821-42f1-b3ae-2bcb70a821f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.264626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d84085-b821-42f1-b3ae-2bcb70a821f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.270362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0944c666-1f43-4a7e-b53e-c7ca0952ae0b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:15.271541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0944c666-1f43-4a7e-b53e-c7ca0952ae0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:15.347309 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 319/631] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:15.347309 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c666-1f43-4a7e-b53e-c7ca0952ae0b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:15.347561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d84085-b821-42f1-b3ae-2bcb70a821f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:15.347561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d84085-b821-42f1-b3ae-2bcb70a821f2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:15.391393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:15.432015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:15.452854 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944c666-1f43-4a7e-b53e-c7ca0952ae0b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:15.459236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 313/632] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:15.459236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d84085-b821-42f1-b3ae-2bcb70a821f2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:15.494614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69a374-4d20-4bf9-9db4-dce41920d092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:15.495662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a374-4d20-4bf9-9db4-dce41920d092 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.495987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a374-4d20-4bf9-9db4-dce41920d092 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.496274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d69a374-4d20-4bf9-9db4-dce41920d092 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.506481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d69a374-4d20-4bf9-9db4-dce41920d092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-6d69a374-4d20-4bf9-9db4-dce41920d092 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:15.514659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:15.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 320/633] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:15.521408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69a374-4d20-4bf9-9db4-dce41920d092 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:15.569543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d84085-b821-42f1-b3ae-2bcb70a821f2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:15.605738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6a38d-0d7e-441b-ba20-b77513946706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:15.606627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6a38d-0d7e-441b-ba20-b77513946706 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.606902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6a38d-0d7e-441b-ba20-b77513946706 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.607172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df6a38d-0d7e-441b-ba20-b77513946706 None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/dff5a11076ea426a8bf760bfee7a5023/roles/917334e4be884c77a974784c424ccde3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.618312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:15.621230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d69a374-4d20-4bf9-9db4-dce41920d092 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:15.621630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6a38d-0d7e-441b-ba20-b77513946706 None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=dff5a11076ea426a8bf760bfee7a5023, role_id=917334e4be884c77a974784c424ccde3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:15.623074 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df6a38d-0d7e-441b-ba20-b77513946706 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:15.655185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4966d9-c6f9-4308-9b03-b510b1f95ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:15.655904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4966d9-c6f9-4308-9b03-b510b1f95ecc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.656217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4966d9-c6f9-4308-9b03-b510b1f95ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.656491 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4966d9-c6f9-4308-9b03-b510b1f95ecc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.667663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4966d9-c6f9-4308-9b03-b510b1f95ecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-dd4966d9-c6f9-4308-9b03-b510b1f95ecc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:15.675377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:15.676522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 321/634] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:15.677425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4966d9-c6f9-4308-9b03-b510b1f95ecc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:15.706466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 314/635] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:50:15 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/dff5a11076ea426a8bf760bfee7a5023/roles/917334e4be884c77a974784c424ccde3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:50:15.708651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6a38d-0d7e-441b-ba20-b77513946706 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:15.747000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:15.795493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4966d9-c6f9-4308-9b03-b510b1f95ecc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:15.836976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd583a30-b0fd-4460-a700-a0c69336c9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:15.837782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd583a30-b0fd-4460-a700-a0c69336c9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.838064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd583a30-b0fd-4460-a700-a0c69336c9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.838337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd583a30-b0fd-4460-a700-a0c69336c9c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.839841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df6a38d-0d7e-441b-ba20-b77513946706 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:15.851294 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd583a30-b0fd-4460-a700-a0c69336c9c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:15.853088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd583a30-b0fd-4460-a700-a0c69336c9c2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-fd583a30-b0fd-4460-a700-a0c69336c9c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:15.874068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:15.875023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:15.876061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:15.876061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:15.876061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:15.876061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:15.877620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 322/636] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:15.878735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c8c4-9926-4ad0-99f0-96ee0672f561 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.879056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c8c4-9926-4ad0-99f0-96ee0672f561 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.879279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94c8c4-9926-4ad0-99f0-96ee0672f561 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.884070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 323/637] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:15.904097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d45596-2718-4e95-8558-6f8bfb09ed90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:15.904251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94c8c4-9926-4ad0-99f0-96ee0672f561 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:15.904331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45596-2718-4e95-8558-6f8bfb09ed90 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:15.904331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45596-2718-4e95-8558-6f8bfb09ed90 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:15.904331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d45596-2718-4e95-8558-6f8bfb09ed90 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:15.904331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d45596-2718-4e95-8558-6f8bfb09ed90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:15.904331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d45596-2718-4e95-8558-6f8bfb09ed90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:15.904331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d45596-2718-4e95-8558-6f8bfb09ed90 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:15.906940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 315/638] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:15.906940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d45596-2718-4e95-8558-6f8bfb09ed90 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:15.907089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:15.999287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94c8c4-9926-4ad0-99f0-96ee0672f561 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.001172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:16.012187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d45596-2718-4e95-8558-6f8bfb09ed90 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.034382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a01f7-a2d0-49e1-bd5d-97a59591d21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.035164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a01f7-a2d0-49e1-bd5d-97a59591d21d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.035449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a01f7-a2d0-49e1-bd5d-97a59591d21d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.035845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a01f7-a2d0-49e1-bd5d-97a59591d21d None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.036631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a01f7-a2d0-49e1-bd5d-97a59591d21d None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:16.036939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a01f7-a2d0-49e1-bd5d-97a59591d21d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:16.038317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a01f7-a2d0-49e1-bd5d-97a59591d21d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:16.047001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 324/639] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:16.048256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15126895-b65c-4fd2-bfc6-c9f03eb1bfc3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.048542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15126895-b65c-4fd2-bfc6-c9f03eb1bfc3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.048817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15126895-b65c-4fd2-bfc6-c9f03eb1bfc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.053115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764d23f-7623-4f8e-9d44-c03c3b83945e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.053778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764d23f-7623-4f8e-9d44-c03c3b83945e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.054058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764d23f-7623-4f8e-9d44-c03c3b83945e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.054330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3764d23f-7623-4f8e-9d44-c03c3b83945e None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.055059 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764d23f-7623-4f8e-9d44-c03c3b83945e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:16.055364 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764d23f-7623-4f8e-9d44-c03c3b83945e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:16.056774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3764d23f-7623-4f8e-9d44-c03c3b83945e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:16.069110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 316/640] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:16.069377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-15126895-b65c-4fd2-bfc6-c9f03eb1bfc3 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:16.070006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764d23f-7623-4f8e-9d44-c03c3b83945e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:16.071045 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-15126895-b65c-4fd2-bfc6-c9f03eb1bfc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:16.155953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 325/641] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:16.155953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15126895-b65c-4fd2-bfc6-c9f03eb1bfc3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:16.155953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:16.202844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3764d23f-7623-4f8e-9d44-c03c3b83945e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.239147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f3015-f97a-4803-b095-e6c718503bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.239958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f3015-f97a-4803-b095-e6c718503bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.240244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f3015-f97a-4803-b095-e6c718503bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.240518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f3015-f97a-4803-b095-e6c718503bc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.251700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f3015-f97a-4803-b095-e6c718503bc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:16.253187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0f3015-f97a-4803-b095-e6c718503bc3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:16.269497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15126895-b65c-4fd2-bfc6-c9f03eb1bfc3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2a0f3015-f97a-4803-b095-e6c718503bc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:16.274730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:16.275606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:16.281968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:16.281968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:16.281968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:16.281968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:16.281968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 317/642] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:16.281968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f3015-f97a-4803-b095-e6c718503bc3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:16.283425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:16.308974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb93c8-369a-4b3d-8b42-77f825b6801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.309858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb93c8-369a-4b3d-8b42-77f825b6801d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.310533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb93c8-369a-4b3d-8b42-77f825b6801d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.310533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb93c8-369a-4b3d-8b42-77f825b6801d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.321663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb93c8-369a-4b3d-8b42-77f825b6801d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:16.323140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb93c8-369a-4b3d-8b42-77f825b6801d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c4bb93c8-369a-4b3d-8b42-77f825b6801d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:16.341655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:16.342640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:16.343548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:16.343548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:16.343548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:16.343548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:16.343548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 326/643] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:16.343853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb93c8-369a-4b3d-8b42-77f825b6801d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:16.394477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0f3015-f97a-4803-b095-e6c718503bc3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.406514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:16.431505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f180f-46cb-47b0-a4fd-1fc5a2da6af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.432332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f180f-46cb-47b0-a4fd-1fc5a2da6af6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.433177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f180f-46cb-47b0-a4fd-1fc5a2da6af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.433443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f180f-46cb-47b0-a4fd-1fc5a2da6af6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.440353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f180f-46cb-47b0-a4fd-1fc5a2da6af6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:16.441835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f180f-46cb-47b0-a4fd-1fc5a2da6af6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:16.453108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb93c8-369a-4b3d-8b42-77f825b6801d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-918f180f-46cb-47b0-a4fd-1fc5a2da6af6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:16.456177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:16.457057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:16.458054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:16.458054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:16.458054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:16.458054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:16.458054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:16.458054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:16.458054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:16.458054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:16.458054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 318/644] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:16.458661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f180f-46cb-47b0-a4fd-1fc5a2da6af6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:16.497348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1cc0d-3eaf-4f5c-8790-0c179bce3ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.498147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1cc0d-3eaf-4f5c-8790-0c179bce3ca4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.498431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1cc0d-3eaf-4f5c-8790-0c179bce3ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.498710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c1cc0d-3eaf-4f5c-8790-0c179bce3ca4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.510694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c1cc0d-3eaf-4f5c-8790-0c179bce3ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-77c1cc0d-3eaf-4f5c-8790-0c179bce3ca4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:16.519131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:16.520102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:16.520954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 327/645] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:16.521793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1cc0d-3eaf-4f5c-8790-0c179bce3ca4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:16.536232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:16.576718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f180f-46cb-47b0-a4fd-1fc5a2da6af6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.612378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d594-d89f-497a-80bb-d4cade59039a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.613152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d594-d89f-497a-80bb-d4cade59039a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.613440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d594-d89f-497a-80bb-d4cade59039a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.613721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11d594-d89f-497a-80bb-d4cade59039a None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.614444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d594-d89f-497a-80bb-d4cade59039a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:16.614773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d594-d89f-497a-80bb-d4cade59039a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:16.616172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11d594-d89f-497a-80bb-d4cade59039a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:16.629130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 319/646] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:16.629939 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d594-d89f-497a-80bb-d4cade59039a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:16.640074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c1cc0d-3eaf-4f5c-8790-0c179bce3ca4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.658795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:16.677618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1cdc-5c52-4871-8c44-2a6c6e1696b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.678278 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1cdc-5c52-4871-8c44-2a6c6e1696b1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.678559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1cdc-5c52-4871-8c44-2a6c6e1696b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.678838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf1cdc-5c52-4871-8c44-2a6c6e1696b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.679563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf1cdc-5c52-4871-8c44-2a6c6e1696b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:16.679867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf1cdc-5c52-4871-8c44-2a6c6e1696b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:16.681313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf1cdc-5c52-4871-8c44-2a6c6e1696b1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:16.694694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 328/647] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:16.695818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1cdc-5c52-4871-8c44-2a6c6e1696b1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:16.743991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11d594-d89f-497a-80bb-d4cade59039a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.770173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:16.782207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03ad23-99a3-4a55-ae66-25b66d7e2ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.782889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03ad23-99a3-4a55-ae66-25b66d7e2ccb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.784560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03ad23-99a3-4a55-ae66-25b66d7e2ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.784560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03ad23-99a3-4a55-ae66-25b66d7e2ccb None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.784560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03ad23-99a3-4a55-ae66-25b66d7e2ccb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:16.784560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03ad23-99a3-4a55-ae66-25b66d7e2ccb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:16.786237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf03ad23-99a3-4a55-ae66-25b66d7e2ccb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:16.803640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 320/648] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:16.803640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03ad23-99a3-4a55-ae66-25b66d7e2ccb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:16.815586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf1cdc-5c52-4871-8c44-2a6c6e1696b1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.852644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b6bc8-a8e1-4a24-86bb-0fff863b433c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.853316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b6bc8-a8e1-4a24-86bb-0fff863b433c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.853591 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b6bc8-a8e1-4a24-86bb-0fff863b433c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.853859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b6bc8-a8e1-4a24-86bb-0fff863b433c None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.855358 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b6bc8-a8e1-4a24-86bb-0fff863b433c None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:16.855658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b6bc8-a8e1-4a24-86bb-0fff863b433c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:16.857141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b6bc8-a8e1-4a24-86bb-0fff863b433c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:16.867963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 329/649] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:16.867963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b6bc8-a8e1-4a24-86bb-0fff863b433c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:16.914624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:16.916761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03ad23-99a3-4a55-ae66-25b66d7e2ccb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.955426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef963721-0dc7-476d-bb25-ed4106057162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:16.956261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef963721-0dc7-476d-bb25-ed4106057162 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:16.956542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef963721-0dc7-476d-bb25-ed4106057162 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:16.956809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef963721-0dc7-476d-bb25-ed4106057162 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:16.966855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef963721-0dc7-476d-bb25-ed4106057162 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:16.968345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef963721-0dc7-476d-bb25-ed4106057162 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:16.982973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b6bc8-a8e1-4a24-86bb-0fff863b433c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ef963721-0dc7-476d-bb25-ed4106057162 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:16.985319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:16.986234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:16.987192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:16.987192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:16.987192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:16.987192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:16.987192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:16.987192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:16.987192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:16.987192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:16.987192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 20 21:50:16.987192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:16.991223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 321/650] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:16.991952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef963721-0dc7-476d-bb25-ed4106057162 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:17.023519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32e515-9a3b-4db4-bfdc-687a783e345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:17.024275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32e515-9a3b-4db4-bfdc-687a783e345e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:17.024605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32e515-9a3b-4db4-bfdc-687a783e345e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:17.024892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e32e515-9a3b-4db4-bfdc-687a783e345e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:17.033792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32e515-9a3b-4db4-bfdc-687a783e345e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:17.035231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e32e515-9a3b-4db4-bfdc-687a783e345e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:17.038466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-6e32e515-9a3b-4db4-bfdc-687a783e345e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:17.050233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:17.054804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:17.055957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:17.055957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:17.055957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:17.055957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:17.055957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:17.055957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:17.055957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:17.055957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:17.055957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 21:50:17.055957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:17.056628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 330/651] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:17.056902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32e515-9a3b-4db4-bfdc-687a783e345e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:17.103240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef963721-0dc7-476d-bb25-ed4106057162 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:17.136815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b27705-346c-44ea-9c69-6a190ce260e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:17.137460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b27705-346c-44ea-9c69-6a190ce260e0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:17.137734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b27705-346c-44ea-9c69-6a190ce260e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:17.138010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b27705-346c-44ea-9c69-6a190ce260e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:17.138834 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b27705-346c-44ea-9c69-6a190ce260e0 None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=5e192a50b09b49b4b7db2508ecf75af5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:17.139140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b27705-346c-44ea-9c69-6a190ce260e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:17.140845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b27705-346c-44ea-9c69-6a190ce260e0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:17.146574 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 322/652] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:16 2022] GET /identity/v3/role_assignments?user.id=5e192a50b09b49b4b7db2508ecf75af5&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:17.147379 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b27705-346c-44ea-9c69-6a190ce260e0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:17.171540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:17.176522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e32e515-9a3b-4db4-bfdc-687a783e345e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:17.221371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea32b8-2216-4e13-9284-7381d8543a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:17.222508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea32b8-2216-4e13-9284-7381d8543a83 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:17.222973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea32b8-2216-4e13-9284-7381d8543a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:17.223400 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea32b8-2216-4e13-9284-7381d8543a83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:17.236156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea32b8-2216-4e13-9284-7381d8543a83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:17.237781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea32b8-2216-4e13-9284-7381d8543a83 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-85ea32b8-2216-4e13-9284-7381d8543a83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:17.256827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:17.258059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:17.259146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:17.259146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:17.259146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:17.259146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:17.266451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 331/653] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:17.267497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea32b8-2216-4e13-9284-7381d8543a83 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:17.292191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b27705-346c-44ea-9c69-6a190ce260e0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:17.303198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:17.343410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceefe5-9964-4c8c-bd80-e8462e0e1517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:17.344798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceefe5-9964-4c8c-bd80-e8462e0e1517 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:17.345225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceefe5-9964-4c8c-bd80-e8462e0e1517 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:17.345876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaceefe5-9964-4c8c-bd80-e8462e0e1517 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:17.347137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceefe5-9964-4c8c-bd80-e8462e0e1517 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:17.347606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceefe5-9964-4c8c-bd80-e8462e0e1517 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:17.349681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaceefe5-9964-4c8c-bd80-e8462e0e1517 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:17.369142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 323/654] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Jul 20 21:50:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:17.370763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceefe5-9964-4c8c-bd80-e8462e0e1517 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:17.397522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea32b8-2216-4e13-9284-7381d8543a83 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:17.447699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f4967-c2a4-4563-b573-32b995e7c174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:17.448849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f4967-c2a4-4563-b573-32b995e7c174 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:17.449149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f4967-c2a4-4563-b573-32b995e7c174 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:17.449739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f4967-c2a4-4563-b573-32b995e7c174 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:17.450892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f4967-c2a4-4563-b573-32b995e7c174 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:17.451203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f4967-c2a4-4563-b573-32b995e7c174 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:17.453276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f4967-c2a4-4563-b573-32b995e7c174 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:17.474391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 332/655] 10.222.0.85 () {56 vars in 1137 bytes} [Wed Jul 20 21:50:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:17.479356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f4967-c2a4-4563-b573-32b995e7c174 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:17.491610 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:17.510345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaceefe5-9964-4c8c-bd80-e8462e0e1517 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:17.548932 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62962d-bb6a-4076-b757-3374fc9d827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:17.549947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62962d-bb6a-4076-b757-3374fc9d827e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:17.550473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62962d-bb6a-4076-b757-3374fc9d827e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:17.550939 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a62962d-bb6a-4076-b757-3374fc9d827e None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:17.551870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62962d-bb6a-4076-b757-3374fc9d827e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:17.552410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62962d-bb6a-4076-b757-3374fc9d827e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:17.553996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a62962d-bb6a-4076-b757-3374fc9d827e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:17.566957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 324/656] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:17.568137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62962d-bb6a-4076-b757-3374fc9d827e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:17.593712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f4967-c2a4-4563-b573-32b995e7c174 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:17.602859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:17.631297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56682f96-ac42-4ad0-b24d-93fa2f695b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:17.632109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56682f96-ac42-4ad0-b24d-93fa2f695b42 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:17.632291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56682f96-ac42-4ad0-b24d-93fa2f695b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:17.632584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56682f96-ac42-4ad0-b24d-93fa2f695b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:17.699382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a62962d-bb6a-4076-b757-3374fc9d827e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:17.715484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56682f96-ac42-4ad0-b24d-93fa2f695b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:17.717907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56682f96-ac42-4ad0-b24d-93fa2f695b42 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:17.728900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:17.739716 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176beaa-ba9f-41b3-952e-dec5fd2ba900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:17.746435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176beaa-ba9f-41b3-952e-dec5fd2ba900 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:17.746435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176beaa-ba9f-41b3-952e-dec5fd2ba900 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:17.746435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176beaa-ba9f-41b3-952e-dec5fd2ba900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:17.824400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176beaa-ba9f-41b3-952e-dec5fd2ba900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:17.826097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176beaa-ba9f-41b3-952e-dec5fd2ba900 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:17.836246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 333/657] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:17.837805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56682f96-ac42-4ad0-b24d-93fa2f695b42 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:17.852722 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:17.933736 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 325/658] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:17.935065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eace1-79fb-46a2-b37e-d59378c5d94f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:17.935352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eace1-79fb-46a2-b37e-d59378c5d94f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:17.935628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eace1-79fb-46a2-b37e-d59378c5d94f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:17.937065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 326/659] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:17.940729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0eace1-79fb-46a2-b37e-d59378c5d94f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:17.956577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56682f96-ac42-4ad0-b24d-93fa2f695b42 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:17.968231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:17.993307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec4135-8c0e-4fa9-a8b4-b1442ed1db74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:17.994095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec4135-8c0e-4fa9-a8b4-b1442ed1db74 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:17.994379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec4135-8c0e-4fa9-a8b4-b1442ed1db74 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:17.994656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdec4135-8c0e-4fa9-a8b4-b1442ed1db74 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.002572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec4135-8c0e-4fa9-a8b4-b1442ed1db74 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:18.004207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdec4135-8c0e-4fa9-a8b4-b1442ed1db74 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bdec4135-8c0e-4fa9-a8b4-b1442ed1db74 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:18.018733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:18.019720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 334/660] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:17 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:18.021116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec4135-8c0e-4fa9-a8b4-b1442ed1db74 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:18.079628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0eace1-79fb-46a2-b37e-d59378c5d94f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:18.106403 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:18.117297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06eff-8444-4174-a3dc-e0359fbb069a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:18.118090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06eff-8444-4174-a3dc-e0359fbb069a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:18.118380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06eff-8444-4174-a3dc-e0359fbb069a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:18.118661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06eff-8444-4174-a3dc-e0359fbb069a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.128195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdec4135-8c0e-4fa9-a8b4-b1442ed1db74 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:18.129487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06eff-8444-4174-a3dc-e0359fbb069a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:18.131029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06eff-8444-4174-a3dc-e0359fbb069a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-efa06eff-8444-4174-a3dc-e0359fbb069a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:18.148916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:18.150020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:18.151166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:18.151166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:18.151166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:18.151166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:18.154641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 327/661] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:18.155938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99781854-6514-4b20-add4-4649dd1f13b8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:18.156229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99781854-6514-4b20-add4-4649dd1f13b8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:18.156505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99781854-6514-4b20-add4-4649dd1f13b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.166591 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d749bdd-24e7-4925-bf30-b91a1a3219f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:18.168060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749bdd-24e7-4925-bf30-b91a1a3219f4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:18.168341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749bdd-24e7-4925-bf30-b91a1a3219f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:18.168611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d749bdd-24e7-4925-bf30-b91a1a3219f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.173392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-99781854-6514-4b20-add4-4649dd1f13b8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:18.174605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-99781854-6514-4b20-add4-4649dd1f13b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:18.180115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d749bdd-24e7-4925-bf30-b91a1a3219f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:18.181562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d749bdd-24e7-4925-bf30-b91a1a3219f4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1d749bdd-24e7-4925-bf30-b91a1a3219f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:18.200726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:18.201670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:18.202542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:18.202542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:18.202542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:18.202542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:18.202542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 335/662] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:18.202913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d749bdd-24e7-4925-bf30-b91a1a3219f4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:18.226894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:18.256450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 328/663] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:18.257293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99781854-6514-4b20-add4-4649dd1f13b8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:18.316154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d749bdd-24e7-4925-bf30-b91a1a3219f4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:18.351139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdff72-609a-44e5-8f73-176ea02acc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:18.351729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdff72-609a-44e5-8f73-176ea02acc43 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:18.352022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdff72-609a-44e5-8f73-176ea02acc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:18.352296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcdff72-609a-44e5-8f73-176ea02acc43 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.353124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdff72-609a-44e5-8f73-176ea02acc43 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:18.353430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdff72-609a-44e5-8f73-176ea02acc43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:18.355483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcdff72-609a-44e5-8f73-176ea02acc43 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:18.372050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99781854-6514-4b20-add4-4649dd1f13b8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:18.377906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 336/664] 10.222.0.85 () {56 vars in 1139 bytes} [Wed Jul 20 21:50:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:18.377906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdff72-609a-44e5-8f73-176ea02acc43 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:18.385031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:18.414191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e90bba-45fa-4a81-9cbb-ab14ebcc57ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:18.414875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90bba-45fa-4a81-9cbb-ab14ebcc57ae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:18.415683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90bba-45fa-4a81-9cbb-ab14ebcc57ae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:18.416016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e90bba-45fa-4a81-9cbb-ab14ebcc57ae None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.417336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e90bba-45fa-4a81-9cbb-ab14ebcc57ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:18.417797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e90bba-45fa-4a81-9cbb-ab14ebcc57ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:18.419191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e90bba-45fa-4a81-9cbb-ab14ebcc57ae None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:18.432188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 329/665] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:18.433464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e90bba-45fa-4a81-9cbb-ab14ebcc57ae None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:18.466013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:18.488959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcdff72-609a-44e5-8f73-176ea02acc43 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:18.527343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d58fb-09f0-4b9c-8f63-194a7819b029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:18.528238 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d58fb-09f0-4b9c-8f63-194a7819b029 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:18.528518 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d58fb-09f0-4b9c-8f63-194a7819b029 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:18.528787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282d58fb-09f0-4b9c-8f63-194a7819b029 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.529652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d58fb-09f0-4b9c-8f63-194a7819b029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:18.529954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d58fb-09f0-4b9c-8f63-194a7819b029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:18.531321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282d58fb-09f0-4b9c-8f63-194a7819b029 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:18.546462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e90bba-45fa-4a81-9cbb-ab14ebcc57ae None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:18.548385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 337/666] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:18.549301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d58fb-09f0-4b9c-8f63-194a7819b029 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:18.581974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a23fb-ef36-4a08-9d46-d1af132c5cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:18.582770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a23fb-ef36-4a08-9d46-d1af132c5cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:18.583054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a23fb-ef36-4a08-9d46-d1af132c5cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:18.583323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a23fb-ef36-4a08-9d46-d1af132c5cb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.594369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a23fb-ef36-4a08-9d46-d1af132c5cb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-786a23fb-ef36-4a08-9d46-d1af132c5cb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:18.602190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:18.603137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 330/667] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:18.605302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a23fb-ef36-4a08-9d46-d1af132c5cb4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:18.633034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:18.665060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282d58fb-09f0-4b9c-8f63-194a7819b029 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:18.703948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553f8b-53a2-4414-b13f-39ee091d9df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:18.704886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553f8b-53a2-4414-b13f-39ee091d9df8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:18.705391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553f8b-53a2-4414-b13f-39ee091d9df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:18.705673 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553f8b-53a2-4414-b13f-39ee091d9df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.712373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a23fb-ef36-4a08-9d46-d1af132c5cb4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:18.716520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:18.749023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396340c2-8fb3-4afa-867f-b57f5eab3929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:18.749815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396340c2-8fb3-4afa-867f-b57f5eab3929 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:18.750095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396340c2-8fb3-4afa-867f-b57f5eab3929 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:18.750367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396340c2-8fb3-4afa-867f-b57f5eab3929 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.757280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396340c2-8fb3-4afa-867f-b57f5eab3929 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:18.758720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396340c2-8fb3-4afa-867f-b57f5eab3929 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-396340c2-8fb3-4afa-867f-b57f5eab3929 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:18.772956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:18.773926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:18.780876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:18.780876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:18.780876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:18.780876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:18.780876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:18.780876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:18.780876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:18.780876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:18.780876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 331/668] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:18.780876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396340c2-8fb3-4afa-867f-b57f5eab3929 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:18.785840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553f8b-53a2-4414-b13f-39ee091d9df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:18.787755 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553f8b-53a2-4414-b13f-39ee091d9df8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:18.866168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:18.881034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396340c2-8fb3-4afa-867f-b57f5eab3929 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:18.898905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 338/669] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:18.899757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553f8b-53a2-4414-b13f-39ee091d9df8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:18.920968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731666-1f4d-4614-835a-0aaa14fcfbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:18.921760 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731666-1f4d-4614-835a-0aaa14fcfbb6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:18.922041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731666-1f4d-4614-835a-0aaa14fcfbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:18.922311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e731666-1f4d-4614-835a-0aaa14fcfbb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:18.929586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e731666-1f4d-4614-835a-0aaa14fcfbb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:18.931031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e731666-1f4d-4614-835a-0aaa14fcfbb6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:18.942041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3e731666-1f4d-4614-835a-0aaa14fcfbb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:18.944823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:18.945698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:18.946726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:18.946726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:18.946726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:18.946726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:18.946726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:18.946726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:18.946726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:18.946726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:18.951513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 332/670] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:18.952419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731666-1f4d-4614-835a-0aaa14fcfbb6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.021804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553f8b-53a2-4414-b13f-39ee091d9df8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:19.059009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994260-6fcb-4dfe-a21f-b3324fea35fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:19.059676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994260-6fcb-4dfe-a21f-b3324fea35fc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.059983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994260-6fcb-4dfe-a21f-b3324fea35fc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.060259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68994260-6fcb-4dfe-a21f-b3324fea35fc None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.060503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e731666-1f4d-4614-835a-0aaa14fcfbb6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:19.061015 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994260-6fcb-4dfe-a21f-b3324fea35fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:19.061318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994260-6fcb-4dfe-a21f-b3324fea35fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:19.062690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68994260-6fcb-4dfe-a21f-b3324fea35fc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:19.076042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 339/671] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:19.076042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994260-6fcb-4dfe-a21f-b3324fea35fc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.102177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8335e-bdf3-4352-a84c-f78c869db556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:19.102935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8335e-bdf3-4352-a84c-f78c869db556 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.103294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8335e-bdf3-4352-a84c-f78c869db556 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.103633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8335e-bdf3-4352-a84c-f78c869db556 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.105351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8335e-bdf3-4352-a84c-f78c869db556 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:19.105732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8335e-bdf3-4352-a84c-f78c869db556 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:19.107247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8335e-bdf3-4352-a84c-f78c869db556 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:19.120002 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 333/672] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:19.121395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8335e-bdf3-4352-a84c-f78c869db556 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.129897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:19.183253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:19.186894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68994260-6fcb-4dfe-a21f-b3324fea35fc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:19.223337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a758c6-cb49-461e-867a-4935aea3ee4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:19.224310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a758c6-cb49-461e-867a-4935aea3ee4d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.224693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a758c6-cb49-461e-867a-4935aea3ee4d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.225097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a758c6-cb49-461e-867a-4935aea3ee4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.230916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8335e-bdf3-4352-a84c-f78c869db556 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:19.238800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a758c6-cb49-461e-867a-4935aea3ee4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:19.240501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a758c6-cb49-461e-867a-4935aea3ee4d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-15a758c6-cb49-461e-867a-4935aea3ee4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:19.259863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:19.260932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:19.261896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:19.261896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:19.261896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:19.261896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:19.262168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 340/673] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:19.262970 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a758c6-cb49-461e-867a-4935aea3ee4d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.279884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f6921-b35f-49ae-98b6-8957afc68972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:19.280814 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f6921-b35f-49ae-98b6-8957afc68972 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.281093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f6921-b35f-49ae-98b6-8957afc68972 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.281365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f6921-b35f-49ae-98b6-8957afc68972 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.282157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f6921-b35f-49ae-98b6-8957afc68972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:19.282497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f6921-b35f-49ae-98b6-8957afc68972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:19.283941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3f6921-b35f-49ae-98b6-8957afc68972 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:19.296729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 334/674] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:19.297546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f6921-b35f-49ae-98b6-8957afc68972 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.365856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:19.385312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a758c6-cb49-461e-867a-4935aea3ee4d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:19.400158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f6921-b35f-49ae-98b6-8957afc68972 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:19.414244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ddbf1-d3fc-4ef4-b7a4-ad62f7b8542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:19.415221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ddbf1-d3fc-4ef4-b7a4-ad62f7b8542c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.415681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ddbf1-d3fc-4ef4-b7a4-ad62f7b8542c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.415980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06ddbf1-d3fc-4ef4-b7a4-ad62f7b8542c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.428146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ddbf1-d3fc-4ef4-b7a4-ad62f7b8542c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:19.429599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06ddbf1-d3fc-4ef4-b7a4-ad62f7b8542c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:19.436776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e058-9799-4076-b566-d99509b8384a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:19.437422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e058-9799-4076-b566-d99509b8384a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.437698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e058-9799-4076-b566-d99509b8384a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.437971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df8e058-9799-4076-b566-d99509b8384a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.438789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e058-9799-4076-b566-d99509b8384a None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=2169b05e64224f69bcc1d9ce912a60e1) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:19.439096 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e058-9799-4076-b566-d99509b8384a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:19.440528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df8e058-9799-4076-b566-d99509b8384a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:19.446555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 335/675] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:19 2022] GET /identity/v3/role_assignments?user.id=2169b05e64224f69bcc1d9ce912a60e1&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f06ddbf1-d3fc-4ef4-b7a4-ad62f7b8542c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:19.446890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:19.447790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:19.449023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:19.449023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:19.449023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:19.449023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:19.449304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e058-9799-4076-b566-d99509b8384a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.449730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 341/676] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:19.450751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ddbf1-d3fc-4ef4-b7a4-ad62f7b8542c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.461575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:19.573581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06ddbf1-d3fc-4ef4-b7a4-ad62f7b8542c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:19.577056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df8e058-9799-4076-b566-d99509b8384a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:19.611735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:19.617163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf55327-6016-443b-ac64-48943b833b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:19.617935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf55327-6016-443b-ac64-48943b833b67 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.618315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf55327-6016-443b-ac64-48943b833b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.618413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6511091-d75a-405b-9d41-fb0ea2be38e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:19.618781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf55327-6016-443b-ac64-48943b833b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.618979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6511091-d75a-405b-9d41-fb0ea2be38e0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.619264 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6511091-d75a-405b-9d41-fb0ea2be38e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.619576 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6511091-d75a-405b-9d41-fb0ea2be38e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.620010 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf55327-6016-443b-ac64-48943b833b67 None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=7153a137b4734df1a057d26509d53dd3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:19.625412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf55327-6016-443b-ac64-48943b833b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:19.625524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6511091-d75a-405b-9d41-fb0ea2be38e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:19.625524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6511091-d75a-405b-9d41-fb0ea2be38e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:19.625689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf55327-6016-443b-ac64-48943b833b67 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:19.625780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6511091-d75a-405b-9d41-fb0ea2be38e0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:19.628273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 342/677] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:19 2022] GET /identity/v3/role_assignments?user.id=7153a137b4734df1a057d26509d53dd3&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:19.629551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921331fe-50b9-47a6-a37f-b03c3906c288 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.629833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921331fe-50b9-47a6-a37f-b03c3906c288 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.630110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921331fe-50b9-47a6-a37f-b03c3906c288 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.631851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 343/678] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:19.633228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921331fe-50b9-47a6-a37f-b03c3906c288 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.635193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 336/679] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:19.641724 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869cdf-4ae0-4b40-9d02-ef060d604af6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.642078 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869cdf-4ae0-4b40-9d02-ef060d604af6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.642453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7869cdf-4ae0-4b40-9d02-ef060d604af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.662632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c7869cdf-4ae0-4b40-9d02-ef060d604af6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:19.663993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c7869cdf-4ae0-4b40-9d02-ef060d604af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:19.739362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:19.771352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 337/680] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:19.772907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7869cdf-4ae0-4b40-9d02-ef060d604af6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.782621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921331fe-50b9-47a6-a37f-b03c3906c288 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:19.826124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977f664-6ed8-4fdd-aec5-41cbb251c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:19.827181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977f664-6ed8-4fdd-aec5-41cbb251c12f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.827664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977f664-6ed8-4fdd-aec5-41cbb251c12f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.828187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2977f664-6ed8-4fdd-aec5-41cbb251c12f None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.829084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977f664-6ed8-4fdd-aec5-41cbb251c12f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:19.829549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977f664-6ed8-4fdd-aec5-41cbb251c12f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:19.831705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2977f664-6ed8-4fdd-aec5-41cbb251c12f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:19.846616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 344/681] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:19.847595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977f664-6ed8-4fdd-aec5-41cbb251c12f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.911106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7869cdf-4ae0-4b40-9d02-ef060d604af6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:19.934860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:19.950978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe7834-1e9f-4890-8e73-754a3ae71676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:19.951824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe7834-1e9f-4890-8e73-754a3ae71676 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:19.952201 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe7834-1e9f-4890-8e73-754a3ae71676 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:19.952485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe7834-1e9f-4890-8e73-754a3ae71676 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:19.960168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe7834-1e9f-4890-8e73-754a3ae71676 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:19.961691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe7834-1e9f-4890-8e73-754a3ae71676 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-befe7834-1e9f-4890-8e73-754a3ae71676 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:19.978140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:19.979130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:19.980166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:19.980166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:19.980166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:19.980166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:19.980166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:19.980166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:19.980166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:19.980166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:19.980166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 338/682] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:19.984926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe7834-1e9f-4890-8e73-754a3ae71676 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:19.986621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2977f664-6ed8-4fdd-aec5-41cbb251c12f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:20.022892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:20.033298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dbb85-2af1-4951-97ea-a03e1b56a54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:20.034439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dbb85-2af1-4951-97ea-a03e1b56a54f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:20.035506 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dbb85-2af1-4951-97ea-a03e1b56a54f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:20.035988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31dbb85-2af1-4951-97ea-a03e1b56a54f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:20.054698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31dbb85-2af1-4951-97ea-a03e1b56a54f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a31dbb85-2af1-4951-97ea-a03e1b56a54f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:20.072001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:20.074531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:20.076183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:20.081360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 345/683] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:20.083279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dbb85-2af1-4951-97ea-a03e1b56a54f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:20.107469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe7834-1e9f-4890-8e73-754a3ae71676 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:20.143891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81634f-d100-49c1-b475-f3543c7381bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:20.144715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81634f-d100-49c1-b475-f3543c7381bf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:20.144996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81634f-d100-49c1-b475-f3543c7381bf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:20.145272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f81634f-d100-49c1-b475-f3543c7381bf None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:20.153108 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81634f-d100-49c1-b475-f3543c7381bf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:20.154619 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f81634f-d100-49c1-b475-f3543c7381bf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1f81634f-d100-49c1-b475-f3543c7381bf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:20.170376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:20.172128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 339/684] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:20.174023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81634f-d100-49c1-b475-f3543c7381bf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:20.244048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31dbb85-2af1-4951-97ea-a03e1b56a54f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:20.249304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:20.288236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e281-9035-4726-b4b4-90c507cefee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:20.289023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e281-9035-4726-b4b4-90c507cefee9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:20.289308 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e281-9035-4726-b4b4-90c507cefee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:20.289582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e281-9035-4726-b4b4-90c507cefee9 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:20.290372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2e281-9035-4726-b4b4-90c507cefee9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:20.290680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2e281-9035-4726-b4b4-90c507cefee9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:20.292254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2e281-9035-4726-b4b4-90c507cefee9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:20.309482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 346/685] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:20.310442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e281-9035-4726-b4b4-90c507cefee9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:20.330017 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f81634f-d100-49c1-b475-f3543c7381bf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:20.373129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:20.375442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc07c-8cba-4b21-9809-eab5b5971ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:20.376405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc07c-8cba-4b21-9809-eab5b5971ebf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:20.376895 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc07c-8cba-4b21-9809-eab5b5971ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:20.377394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ffc07c-8cba-4b21-9809-eab5b5971ebf None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:20.378802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc07c-8cba-4b21-9809-eab5b5971ebf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:20.379561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc07c-8cba-4b21-9809-eab5b5971ebf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:20.381761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ffc07c-8cba-4b21-9809-eab5b5971ebf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:20.393487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 340/686] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:20.394585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc07c-8cba-4b21-9809-eab5b5971ebf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:20.444419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e281-9035-4726-b4b4-90c507cefee9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:20.489215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93042377-2f43-4657-bd74-65d2c46beac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:20.490240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93042377-2f43-4657-bd74-65d2c46beac9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:20.490797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93042377-2f43-4657-bd74-65d2c46beac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:20.491389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93042377-2f43-4657-bd74-65d2c46beac9 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:20.492482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93042377-2f43-4657-bd74-65d2c46beac9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:20.492998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93042377-2f43-4657-bd74-65d2c46beac9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:20.495435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93042377-2f43-4657-bd74-65d2c46beac9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:20.513840 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ffc07c-8cba-4b21-9809-eab5b5971ebf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:20.515658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:20.518949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 347/687] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Jul 20 21:50:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:20.520215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93042377-2f43-4657-bd74-65d2c46beac9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:20.560982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e93ea-f381-4417-84e0-10be1e035952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:20.561682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e93ea-f381-4417-84e0-10be1e035952 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:20.562849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e93ea-f381-4417-84e0-10be1e035952 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:20.563124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e93ea-f381-4417-84e0-10be1e035952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:20.564001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e93ea-f381-4417-84e0-10be1e035952 None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=2ad07969d5a043e7b83e403da35120da) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:20.564315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e93ea-f381-4417-84e0-10be1e035952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:20.565770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628e93ea-f381-4417-84e0-10be1e035952 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:20.573687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 341/688] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:20 2022] GET /identity/v3/role_assignments?user.id=2ad07969d5a043e7b83e403da35120da&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:20.574671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e93ea-f381-4417-84e0-10be1e035952 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:20.641231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93042377-2f43-4657-bd74-65d2c46beac9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:20.650825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:20.687414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bc34c-d4ab-43bc-b1e5-806ada8b40c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:20.688440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc34c-d4ab-43bc-b1e5-806ada8b40c9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:20.688735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc34c-d4ab-43bc-b1e5-806ada8b40c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:20.689007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bc34c-d4ab-43bc-b1e5-806ada8b40c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:20.704065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bc34c-d4ab-43bc-b1e5-806ada8b40c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:20.705707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bc34c-d4ab-43bc-b1e5-806ada8b40c9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:20.707051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e93ea-f381-4417-84e0-10be1e035952 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-024bc34c-d4ab-43bc-b1e5-806ada8b40c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:20.725168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:20.726118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:20.727474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:20.727474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:20.727474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:20.727474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:20.727474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 348/689] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:20.733332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bc34c-d4ab-43bc-b1e5-806ada8b40c9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:20.750024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5328410-0535-4a02-b74b-afb40be77406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:20.750926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5328410-0535-4a02-b74b-afb40be77406 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:20.751684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5328410-0535-4a02-b74b-afb40be77406 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:20.751987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5328410-0535-4a02-b74b-afb40be77406 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:20.800094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:20.852064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5328410-0535-4a02-b74b-afb40be77406 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:20.855128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5328410-0535-4a02-b74b-afb40be77406 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:20.857343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bc34c-d4ab-43bc-b1e5-806ada8b40c9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:20.900754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4f7dc-2db1-42ea-9d23-f8c158cc84c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:20.902219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4f7dc-2db1-42ea-9d23-f8c158cc84c5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:20.902636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4f7dc-2db1-42ea-9d23-f8c158cc84c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:20.902916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4f7dc-2db1-42ea-9d23-f8c158cc84c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:20.903670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4f7dc-2db1-42ea-9d23-f8c158cc84c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:20.904271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4f7dc-2db1-42ea-9d23-f8c158cc84c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:20.905666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce4f7dc-2db1-42ea-9d23-f8c158cc84c5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:20.920206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 349/690] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:20.926558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4f7dc-2db1-42ea-9d23-f8c158cc84c5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:20.957462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:20.999987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 342/691] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:21.002543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5328410-0535-4a02-b74b-afb40be77406 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:21.074901 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4f7dc-2db1-42ea-9d23-f8c158cc84c5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:21.080705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:21.119909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7e46c-fd4e-40b1-ba18-01f5a5136911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:21.121277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7e46c-fd4e-40b1-ba18-01f5a5136911 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:21.121700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7e46c-fd4e-40b1-ba18-01f5a5136911 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:21.122612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d7e46c-fd4e-40b1-ba18-01f5a5136911 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:21.126289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5328410-0535-4a02-b74b-afb40be77406 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:21.132256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7e46c-fd4e-40b1-ba18-01f5a5136911 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:21.133854 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d7e46c-fd4e-40b1-ba18-01f5a5136911 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-53d7e46c-fd4e-40b1-ba18-01f5a5136911 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:21.150524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:21.152315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:21.153354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:21.153354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:21.153354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:21.153354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:21.153354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:21.153354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:21.153354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:21.153354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:21.153354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:21.153354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:21.155884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 350/692] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Jul 20 21:50:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:21.165001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7e46c-fd4e-40b1-ba18-01f5a5136911 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:21.201399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba548-0197-43b4-a7ce-98fc5f585dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:21.202193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba548-0197-43b4-a7ce-98fc5f585dea None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:21.202474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba548-0197-43b4-a7ce-98fc5f585dea None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:21.202746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ba548-0197-43b4-a7ce-98fc5f585dea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:21.221562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ba548-0197-43b4-a7ce-98fc5f585dea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:21.223022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ba548-0197-43b4-a7ce-98fc5f585dea None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-971ba548-0197-43b4-a7ce-98fc5f585dea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:21.259624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:21.260771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:21.262007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:21.262007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:21.262007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:21.262007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:21.262007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 343/693] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:21.268835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba548-0197-43b4-a7ce-98fc5f585dea None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:21.340741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:21.377978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d7e46c-fd4e-40b1-ba18-01f5a5136911 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:21.436044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ba548-0197-43b4-a7ce-98fc5f585dea None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:21.449498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6c4d-a24a-4713-a1ec-4e9e35d55b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:21.450432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6c4d-a24a-4713-a1ec-4e9e35d55b10 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:21.450855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6c4d-a24a-4713-a1ec-4e9e35d55b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:21.451268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e6c4d-a24a-4713-a1ec-4e9e35d55b10 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:21.452385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6c4d-a24a-4713-a1ec-4e9e35d55b10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:21.452848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6c4d-a24a-4713-a1ec-4e9e35d55b10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:21.454411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e6c4d-a24a-4713-a1ec-4e9e35d55b10 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:21.474264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 351/694] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Jul 20 21:50:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:21.482577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:21.483222 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6c4d-a24a-4713-a1ec-4e9e35d55b10 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:21.501367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01710d-3837-4796-9e7c-8e0f64447e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:21.502006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01710d-3837-4796-9e7c-8e0f64447e61 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:21.502285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01710d-3837-4796-9e7c-8e0f64447e61 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:21.502558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01710d-3837-4796-9e7c-8e0f64447e61 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:21.503556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01710d-3837-4796-9e7c-8e0f64447e61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:21.503885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01710d-3837-4796-9e7c-8e0f64447e61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:21.505686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01710d-3837-4796-9e7c-8e0f64447e61 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:21.523672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 344/695] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:21.524631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01710d-3837-4796-9e7c-8e0f64447e61 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:21.645887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01710d-3837-4796-9e7c-8e0f64447e61 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:21.684180 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d61594-3c4b-4226-a955-2ab2d55bd4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:21.685034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d61594-3c4b-4226-a955-2ab2d55bd4df None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:21.685315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d61594-3c4b-4226-a955-2ab2d55bd4df None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:21.685587 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d61594-3c4b-4226-a955-2ab2d55bd4df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:21.693261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d61594-3c4b-4226-a955-2ab2d55bd4df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:21.694999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d61594-3c4b-4226-a955-2ab2d55bd4df None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-55d61594-3c4b-4226-a955-2ab2d55bd4df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:21.714947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:21.716120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:21.717195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:21.717195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:21.717195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:21.717195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:21.717195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:21.717195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:21.717195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:21.717195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:21.717718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 345/696] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:21.722818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d61594-3c4b-4226-a955-2ab2d55bd4df None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:21.754207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e6c4d-a24a-4713-a1ec-4e9e35d55b10 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:21.776607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:21.791136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd54c6b-4e1c-4883-8c03-84e2d9ece1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:21.792799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54c6b-4e1c-4883-8c03-84e2d9ece1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:21.792799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54c6b-4e1c-4883-8c03-84e2d9ece1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:21.793075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd54c6b-4e1c-4883-8c03-84e2d9ece1b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:21.808227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:21.881488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d61594-3c4b-4226-a955-2ab2d55bd4df None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:21.918256 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb4ea2-ee99-426f-b3a2-bc0ab6e378dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:21.918925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb4ea2-ee99-426f-b3a2-bc0ab6e378dd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:21.919208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb4ea2-ee99-426f-b3a2-bc0ab6e378dd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:21.919483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecb4ea2-ee99-426f-b3a2-bc0ab6e378dd None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:21.920313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb4ea2-ee99-426f-b3a2-bc0ab6e378dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:21.920752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb4ea2-ee99-426f-b3a2-bc0ab6e378dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:21.922242 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ecb4ea2-ee99-426f-b3a2-bc0ab6e378dd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:21.935698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 346/697] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:21.937072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd54c6b-4e1c-4883-8c03-84e2d9ece1b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:21.938760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd54c6b-4e1c-4883-8c03-84e2d9ece1b9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:21.941555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb4ea2-ee99-426f-b3a2-bc0ab6e378dd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:22.051088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ecb4ea2-ee99-426f-b3a2-bc0ab6e378dd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:22.072335 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:22.073815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 352/698] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:22.079661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d6f8d-b5ce-468c-902d-facc0d213a20 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.080246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d6f8d-b5ce-468c-902d-facc0d213a20 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.080246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d6f8d-b5ce-468c-902d-facc0d213a20 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.081947 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 353/699] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:22.082717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d6f8d-b5ce-468c-902d-facc0d213a20 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:22.087324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92307ba4-3294-4697-b835-c5663dc2a046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:22.088094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92307ba4-3294-4697-b835-c5663dc2a046 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.088474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92307ba4-3294-4697-b835-c5663dc2a046 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.088821 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92307ba4-3294-4697-b835-c5663dc2a046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.089745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92307ba4-3294-4697-b835-c5663dc2a046 None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=dff5a11076ea426a8bf760bfee7a5023) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:22.090133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92307ba4-3294-4697-b835-c5663dc2a046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:22.091820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92307ba4-3294-4697-b835-c5663dc2a046 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:22.098637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 347/700] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:21 2022] GET /identity/v3/role_assignments?user.id=dff5a11076ea426a8bf760bfee7a5023&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:22.099951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a784a3e-5c2b-4f61-a6b5-036627c40096 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.108473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a784a3e-5c2b-4f61-a6b5-036627c40096 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.108798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a784a3e-5c2b-4f61-a6b5-036627c40096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.124072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:22.138193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4a784a3e-5c2b-4f61-a6b5-036627c40096 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:22.139672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4a784a3e-5c2b-4f61-a6b5-036627c40096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:22.211109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d6f8d-b5ce-468c-902d-facc0d213a20 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:22.228773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 348/701] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:22.231539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482c666-9294-4f96-b136-f1435dcee341 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.232062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482c666-9294-4f96-b136-f1435dcee341 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.232464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482c666-9294-4f96-b136-f1435dcee341 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.234372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 349/702] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:22.246793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45102-f45d-4a24-95ab-8f301c725300 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.247445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45102-f45d-4a24-95ab-8f301c725300 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.247955 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45102-f45d-4a24-95ab-8f301c725300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.263163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d10cd-c39b-4ebd-905f-7e99d94db95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:22.264026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d10cd-c39b-4ebd-905f-7e99d94db95d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.264298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d10cd-c39b-4ebd-905f-7e99d94db95d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.264603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177d10cd-c39b-4ebd-905f-7e99d94db95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.269302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-48e45102-f45d-4a24-95ab-8f301c725300 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:22.270968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-48e45102-f45d-4a24-95ab-8f301c725300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:22.284187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d10cd-c39b-4ebd-905f-7e99d94db95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:22.285690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177d10cd-c39b-4ebd-905f-7e99d94db95d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-177d10cd-c39b-4ebd-905f-7e99d94db95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:22.308277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:22.309389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:22.310661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:22.310661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:22.310661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:22.310661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:22.310661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 354/703] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:22.310661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d10cd-c39b-4ebd-905f-7e99d94db95d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:22.362178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 350/704] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 20 21:50:22.363119 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e45102-f45d-4a24-95ab-8f301c725300 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:22.391232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:22.437459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:22.452068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177d10cd-c39b-4ebd-905f-7e99d94db95d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:22.484984 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e45102-f45d-4a24-95ab-8f301c725300 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:22.498263 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa6078-ad50-4e66-9c23-3fad47596668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:22.499152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa6078-ad50-4e66-9c23-3fad47596668 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.499535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa6078-ad50-4e66-9c23-3fad47596668 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.499990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa6078-ad50-4e66-9c23-3fad47596668 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.511554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa6078-ad50-4e66-9c23-3fad47596668 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:22.513173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa6078-ad50-4e66-9c23-3fad47596668 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:22.523706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d002d-c1f7-431a-9796-29aa5a360d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:22.524700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d002d-c1f7-431a-9796-29aa5a360d7f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.525165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d002d-c1f7-431a-9796-29aa5a360d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.525648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324d002d-c1f7-431a-9796-29aa5a360d7f None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.527443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d002d-c1f7-431a-9796-29aa5a360d7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:22.528012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d002d-c1f7-431a-9796-29aa5a360d7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:22.529570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324d002d-c1f7-431a-9796-29aa5a360d7f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-60fa6078-ad50-4e66-9c23-3fad47596668 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:22.534772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:22.535670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:22.536650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:22.536650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:22.536650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:22.536650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:22.536650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 355/705] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:22.537132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa6078-ad50-4e66-9c23-3fad47596668 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:22.549411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 351/706] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:22.554863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d002d-c1f7-431a-9796-29aa5a360d7f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:22.648042 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:22.670326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324d002d-c1f7-431a-9796-29aa5a360d7f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:22.672544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa6078-ad50-4e66-9c23-3fad47596668 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:22.708209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2bda9-f879-4282-8903-b3c301178f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:22.709272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2bda9-f879-4282-8903-b3c301178f47 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.709759 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2bda9-f879-4282-8903-b3c301178f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.710257 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2bda9-f879-4282-8903-b3c301178f47 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.711183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2bda9-f879-4282-8903-b3c301178f47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:22.711690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2bda9-f879-4282-8903-b3c301178f47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:22.713298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2bda9-f879-4282-8903-b3c301178f47 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:22.715368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7667352-dc53-4d0a-b04a-051316cfef43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:22.716301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7667352-dc53-4d0a-b04a-051316cfef43 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.716718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7667352-dc53-4d0a-b04a-051316cfef43 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.716996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7667352-dc53-4d0a-b04a-051316cfef43 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.717656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7667352-dc53-4d0a-b04a-051316cfef43 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:22.719470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7667352-dc53-4d0a-b04a-051316cfef43 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:22.729761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 352/707] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:22.731022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2bda9-f879-4282-8903-b3c301178f47 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e7667352-dc53-4d0a-b04a-051316cfef43 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:22.735851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:22.737004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 21:50:22.737878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:22.740924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 356/708] 10.222.0.85 () {56 vars in 1129 bytes} [Wed Jul 20 21:50:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:22.741928 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7667352-dc53-4d0a-b04a-051316cfef43 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:22.766587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:22.866685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2bda9-f879-4282-8903-b3c301178f47 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:22.868751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7667352-dc53-4d0a-b04a-051316cfef43 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:22.905483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401cdb3-7c0d-41ce-8937-44f0f508c2fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:22.906949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401cdb3-7c0d-41ce-8937-44f0f508c2fd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.907439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401cdb3-7c0d-41ce-8937-44f0f508c2fd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.907940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401cdb3-7c0d-41ce-8937-44f0f508c2fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.913271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea25d84-8f22-44a0-b774-6cdb65177a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:22.913938 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea25d84-8f22-44a0-b774-6cdb65177a86 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:22.914219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea25d84-8f22-44a0-b774-6cdb65177a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:22.914489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea25d84-8f22-44a0-b774-6cdb65177a86 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:22.915338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea25d84-8f22-44a0-b774-6cdb65177a86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:22.916708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401cdb3-7c0d-41ce-8937-44f0f508c2fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:22.917103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea25d84-8f22-44a0-b774-6cdb65177a86 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:22.918887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401cdb3-7c0d-41ce-8937-44f0f508c2fd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d401cdb3-7c0d-41ce-8937-44f0f508c2fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:22.934805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:22.935737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:22.942583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:22.942583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:22.942583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:22.942583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:22.942583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:22.942583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:22.942583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:22.942583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:22.942583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 353/709] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:22.942583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401cdb3-7c0d-41ce-8937-44f0f508c2fd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:22.943856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:22.981151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 357/710] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:50:22 2022] POST /identity/v3/users => generated 254 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:22.982423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea25d84-8f22-44a0-b774-6cdb65177a86 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:23.093727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401cdb3-7c0d-41ce-8937-44f0f508c2fd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:23.134471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95fdf9-7e30-4b51-82e2-4f719cfce6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:23.138130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95fdf9-7e30-4b51-82e2-4f719cfce6aa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:23.140170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95fdf9-7e30-4b51-82e2-4f719cfce6aa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:23.141564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95fdf9-7e30-4b51-82e2-4f719cfce6aa None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:23.142535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95fdf9-7e30-4b51-82e2-4f719cfce6aa None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:23.143326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95fdf9-7e30-4b51-82e2-4f719cfce6aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:23.146080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95fdf9-7e30-4b51-82e2-4f719cfce6aa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:23.149833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:23.158758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 354/711] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Jul 20 21:50:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:23.164254 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95fdf9-7e30-4b51-82e2-4f719cfce6aa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:23.209535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea25d84-8f22-44a0-b774-6cdb65177a86 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:23.252231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:23.263369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5453b4-a458-4c83-9c9f-7a334025aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:23.266387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5453b4-a458-4c83-9c9f-7a334025aced None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:23.266387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5453b4-a458-4c83-9c9f-7a334025aced None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:23.266387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5453b4-a458-4c83-9c9f-7a334025aced None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:23.266387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5453b4-a458-4c83-9c9f-7a334025aced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:23.266683 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5453b4-a458-4c83-9c9f-7a334025aced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:23.268565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5453b4-a458-4c83-9c9f-7a334025aced None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:23.293194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 358/712] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:23.294551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95fdf9-7e30-4b51-82e2-4f719cfce6aa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:23.294685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd619-0dce-4fc0-84cb-de5ba94cd1ad None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:23.294853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd619-0dce-4fc0-84cb-de5ba94cd1ad None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:23.295137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3dd619-0dce-4fc0-84cb-de5ba94cd1ad None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:23.296718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 359/713] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:23.302191 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c38b-e4e2-4b87-beb0-ae3bb2cd9c0f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:23.302636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c38b-e4e2-4b87-beb0-ae3bb2cd9c0f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:23.303278 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c38b-e4e2-4b87-beb0-ae3bb2cd9c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:23.326093 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7e03c38b-e4e2-4b87-beb0-ae3bb2cd9c0f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:23.327451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7e03c38b-e4e2-4b87-beb0-ae3bb2cd9c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:23.337995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0eacb-7612-45dd-a9ab-c35aa484a7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:23.338902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0eacb-7612-45dd-a9ab-c35aa484a7ef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:23.339378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0eacb-7612-45dd-a9ab-c35aa484a7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:23.339949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0eacb-7612-45dd-a9ab-c35aa484a7ef None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:23.340568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0eacb-7612-45dd-a9ab-c35aa484a7ef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:23.340884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0eacb-7612-45dd-a9ab-c35aa484a7ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:23.342328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0eacb-7612-45dd-a9ab-c35aa484a7ef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:23.348997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 355/714] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Jul 20 21:50:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:23.349848 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0eacb-7612-45dd-a9ab-c35aa484a7ef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:23.416290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 360/715] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 20 21:50:23.451810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03c38b-e4e2-4b87-beb0-ae3bb2cd9c0f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:23.519032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0eacb-7612-45dd-a9ab-c35aa484a7ef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:23.547022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:23.585392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:23.595870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af7664-bdd8-43a3-b743-d7de2569f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:23.597230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af7664-bdd8-43a3-b743-d7de2569f1cf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:23.597723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af7664-bdd8-43a3-b743-d7de2569f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:23.598163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af7664-bdd8-43a3-b743-d7de2569f1cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:23.599536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af7664-bdd8-43a3-b743-d7de2569f1cf None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=5e192a50b09b49b4b7db2508ecf75af5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:23.600060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af7664-bdd8-43a3-b743-d7de2569f1cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:23.601981 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af7664-bdd8-43a3-b743-d7de2569f1cf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:23.610934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 356/716] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:23 2022] GET /identity/v3/role_assignments?user.id=5e192a50b09b49b4b7db2508ecf75af5&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:23.635578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e03c38b-e4e2-4b87-beb0-ae3bb2cd9c0f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:23.703830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d592b-6243-40f2-a9be-22324585bcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:23.704589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d592b-6243-40f2-a9be-22324585bcad None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:23.704871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d592b-6243-40f2-a9be-22324585bcad None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:23.705161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d592b-6243-40f2-a9be-22324585bcad None admin] PATH_INFO: `/v3/services/network` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:23.705814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d592b-6243-40f2-a9be-22324585bcad None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:23.707363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d592b-6243-40f2-a9be-22324585bcad None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-373d592b-6243-40f2-a9be-22324585bcad None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:23.724952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:23.726019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 21:50:23.726852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:23.730037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 361/717] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:23 2022] GET /identity/v3/services/network => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:23.737102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af7664-bdd8-43a3-b743-d7de2569f1cf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:23.870558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af7664-bdd8-43a3-b743-d7de2569f1cf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:23.913039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9f9fe-12b7-4e10-8973-1e2153273bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:23.913696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9f9fe-12b7-4e10-8973-1e2153273bbd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:23.914012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9f9fe-12b7-4e10-8973-1e2153273bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:23.914293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9f9fe-12b7-4e10-8973-1e2153273bbd None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:23.915036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9f9fe-12b7-4e10-8973-1e2153273bbd None admin] RBAC: Adding query filter params (name=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:23.915385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9f9fe-12b7-4e10-8973-1e2153273bbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:23.917446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9f9fe-12b7-4e10-8973-1e2153273bbd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:23.922417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 357/718] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:23.928509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d592b-6243-40f2-a9be-22324585bcad None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:24.098689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d592b-6243-40f2-a9be-22324585bcad None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:24.118980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:24.142658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b20512-2cd6-40ac-826f-7d5b0277b8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:24.143325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b20512-2cd6-40ac-826f-7d5b0277b8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:24.143609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b20512-2cd6-40ac-826f-7d5b0277b8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:24.143910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b20512-2cd6-40ac-826f-7d5b0277b8d5 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:24.144624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b20512-2cd6-40ac-826f-7d5b0277b8d5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:24.144924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b20512-2cd6-40ac-826f-7d5b0277b8d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:24.146290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b20512-2cd6-40ac-826f-7d5b0277b8d5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:24.156799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 362/719] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:24.548918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725defc1-b7bd-4635-ad69-56dd2fa45c7b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:24.549333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725defc1-b7bd-4635-ad69-56dd2fa45c7b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:24.549522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725defc1-b7bd-4635-ad69-56dd2fa45c7b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:24.551199 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 358/720] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:24.556391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3394936-d551-48c9-b212-2135f202b7c4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:24.556682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3394936-d551-48c9-b212-2135f202b7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:24.556960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3394936-d551-48c9-b212-2135f202b7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:24.576184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e3394936-d551-48c9-b212-2135f202b7c4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:24.577402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e3394936-d551-48c9-b212-2135f202b7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:24.661571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 363/721] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:24.685359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725defc1-b7bd-4635-ad69-56dd2fa45c7b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:24.761615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:24.824768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725defc1-b7bd-4635-ad69-56dd2fa45c7b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:24.868549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c4a4a-5ce7-48b7-ae73-8ba229b86779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:24.869339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4a4a-5ce7-48b7-ae73-8ba229b86779 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:24.869691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4a4a-5ce7-48b7-ae73-8ba229b86779 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:24.870024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c4a4a-5ce7-48b7-ae73-8ba229b86779 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:24.888779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c4a4a-5ce7-48b7-ae73-8ba229b86779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7e3c4a4a-5ce7-48b7-ae73-8ba229b86779 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:24.896527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:24.897451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:24.898317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 359/722] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:24.904474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3394936-d551-48c9-b212-2135f202b7c4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:25.047626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3394936-d551-48c9-b212-2135f202b7c4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:25.062008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:25.097573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426e6b4-c7ae-42c1-84f2-32522e745786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:25.098170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e6b4-c7ae-42c1-84f2-32522e745786 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:25.098449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e6b4-c7ae-42c1-84f2-32522e745786 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:25.098720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426e6b4-c7ae-42c1-84f2-32522e745786 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:25.099474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426e6b4-c7ae-42c1-84f2-32522e745786 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:25.099779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426e6b4-c7ae-42c1-84f2-32522e745786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:25.101170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e426e6b4-c7ae-42c1-84f2-32522e745786 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:25.109894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 364/723] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:25.115439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c4a4a-5ce7-48b7-ae73-8ba229b86779 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:25.272786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c4a4a-5ce7-48b7-ae73-8ba229b86779 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:25.300774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:25.324267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61be31-17aa-4eb9-998b-1cc398af9916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:25.325066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61be31-17aa-4eb9-998b-1cc398af9916 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:25.325416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61be31-17aa-4eb9-998b-1cc398af9916 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:25.325695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61be31-17aa-4eb9-998b-1cc398af9916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:25.339754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61be31-17aa-4eb9-998b-1cc398af9916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:25.341270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61be31-17aa-4eb9-998b-1cc398af9916 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2c61be31-17aa-4eb9-998b-1cc398af9916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:25.362754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:25.363723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:25.364684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:25.364684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:25.364684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:25.364684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:25.365419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 360/724] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:25.373049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426e6b4-c7ae-42c1-84f2-32522e745786 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:25.513079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426e6b4-c7ae-42c1-84f2-32522e745786 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:25.548369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc69e7-a735-4724-81f6-67671cd61c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:25.549219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc69e7-a735-4724-81f6-67671cd61c01 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:25.549497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc69e7-a735-4724-81f6-67671cd61c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:25.549766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fc69e7-a735-4724-81f6-67671cd61c01 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:25.550727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc69e7-a735-4724-81f6-67671cd61c01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:25.551070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc69e7-a735-4724-81f6-67671cd61c01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:25.552494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fc69e7-a735-4724-81f6-67671cd61c01 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:25.565664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 365/725] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:25.571064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61be31-17aa-4eb9-998b-1cc398af9916 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:25.729393 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61be31-17aa-4eb9-998b-1cc398af9916 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:25.783721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e458e-a6b4-45d6-9386-499eb170f940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:25.784575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e458e-a6b4-45d6-9386-499eb170f940 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:25.784859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e458e-a6b4-45d6-9386-499eb170f940 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:25.785137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e458e-a6b4-45d6-9386-499eb170f940 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:25.801261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e458e-a6b4-45d6-9386-499eb170f940 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:25.802750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1e458e-a6b4-45d6-9386-499eb170f940 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5d1e458e-a6b4-45d6-9386-499eb170f940 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:25.824118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:25.825138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:25.826077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:25.826077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:25.826077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:25.826077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:25.826077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:25.826077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:25.826077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:25.826077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:25.826077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:25.826077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:25.828196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 361/726] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:25.833364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc69e7-a735-4724-81f6-67671cd61c01 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:25.881885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:25.966265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520b752-16fb-409a-8cb5-6637ab7d54a9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:25.966868 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520b752-16fb-409a-8cb5-6637ab7d54a9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:25.967343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520b752-16fb-409a-8cb5-6637ab7d54a9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:25.969353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 362/727] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:25.974504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fc69e7-a735-4724-81f6-67671cd61c01 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:25.977338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdfcd7-0533-473b-9285-9bb889019181 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:25.977740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdfcd7-0533-473b-9285-9bb889019181 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:25.978119 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cdfcd7-0533-473b-9285-9bb889019181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.014792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f2cdfcd7-0533-473b-9285-9bb889019181 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:26.016368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f2cdfcd7-0533-473b-9285-9bb889019181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:26.016593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d502f-66dd-4811-ac10-7715c784b1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:26.017425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d502f-66dd-4811-ac10-7715c784b1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.017847 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d502f-66dd-4811-ac10-7715c784b1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.018257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d502f-66dd-4811-ac10-7715c784b1e5 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.019249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d502f-66dd-4811-ac10-7715c784b1e5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:26.019710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d502f-66dd-4811-ac10-7715c784b1e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:26.021289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d502f-66dd-4811-ac10-7715c784b1e5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:26.040765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 366/728] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Jul 20 21:50:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:26.047635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:26.048112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306b1f2-e66d-4a19-9761-017bc2c1eb90 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.048597 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306b1f2-e66d-4a19-9761-017bc2c1eb90 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.049736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e306b1f2-e66d-4a19-9761-017bc2c1eb90 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.051692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 367/729] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:26.052684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306b1f2-e66d-4a19-9761-017bc2c1eb90 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:26.093612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 363/730] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:26.095706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd774d7-6cfd-4512-ae23-6f38d0d75185 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.096103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd774d7-6cfd-4512-ae23-6f38d0d75185 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.096381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd774d7-6cfd-4512-ae23-6f38d0d75185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.117040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2cd774d7-6cfd-4512-ae23-6f38d0d75185 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:26.118322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2cd774d7-6cfd-4512-ae23-6f38d0d75185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:26.164583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:26.181541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e306b1f2-e66d-4a19-9761-017bc2c1eb90 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:26.204012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 364/731] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:26.205165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd774d7-6cfd-4512-ae23-6f38d0d75185 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:26.233771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90c6f-39b8-472e-8ac4-b700280c3218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:26.234420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90c6f-39b8-472e-8ac4-b700280c3218 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.234698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90c6f-39b8-472e-8ac4-b700280c3218 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.234968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c90c6f-39b8-472e-8ac4-b700280c3218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.310420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c90c6f-39b8-472e-8ac4-b700280c3218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:26.311368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:26.312381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c90c6f-39b8-472e-8ac4-b700280c3218 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:26.321112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd774d7-6cfd-4512-ae23-6f38d0d75185 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:26.359748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcca0b9-a345-4f13-b183-0c1fb2dd33bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:26.360570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcca0b9-a345-4f13-b183-0c1fb2dd33bb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.360854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcca0b9-a345-4f13-b183-0c1fb2dd33bb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.361129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcca0b9-a345-4f13-b183-0c1fb2dd33bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.371790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcca0b9-a345-4f13-b183-0c1fb2dd33bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cfcca0b9-a345-4f13-b183-0c1fb2dd33bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:26.379439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:26.380419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:26.381275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 365/732] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:26.381956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c01edd-6c05-4c21-b8a2-85b98f7b5fe6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.382374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c01edd-6c05-4c21-b8a2-85b98f7b5fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.382504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c01edd-6c05-4c21-b8a2-85b98f7b5fe6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.387959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 366/733] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:26.387959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c01edd-6c05-4c21-b8a2-85b98f7b5fe6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:26.414805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:26.431642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 368/734] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 20 21:50:26.431642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90c6f-39b8-472e-8ac4-b700280c3218 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:26.516250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c01edd-6c05-4c21-b8a2-85b98f7b5fe6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:26.535563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c90c6f-39b8-472e-8ac4-b700280c3218 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:26.561300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515d39e-ce76-4f85-acfc-72c303262f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:26.561882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515d39e-ce76-4f85-acfc-72c303262f72 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.562160 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515d39e-ce76-4f85-acfc-72c303262f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.562429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515d39e-ce76-4f85-acfc-72c303262f72 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.563147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515d39e-ce76-4f85-acfc-72c303262f72 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:26.564547 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515d39e-ce76-4f85-acfc-72c303262f72 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:26.577553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07705bbe-798f-4f28-8d7e-76f17a95b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:26.579354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07705bbe-798f-4f28-8d7e-76f17a95b836 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.579354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07705bbe-798f-4f28-8d7e-76f17a95b836 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.579354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07705bbe-798f-4f28-8d7e-76f17a95b836 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.579774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07705bbe-798f-4f28-8d7e-76f17a95b836 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:26.579774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07705bbe-798f-4f28-8d7e-76f17a95b836 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:26.581150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07705bbe-798f-4f28-8d7e-76f17a95b836 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:26.590919 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 369/735] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:26.592146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445d5aa-530f-4b1f-af7c-6559c65ff23f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.592435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445d5aa-530f-4b1f-af7c-6559c65ff23f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.592728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0445d5aa-530f-4b1f-af7c-6559c65ff23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.610463 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0445d5aa-530f-4b1f-af7c-6559c65ff23f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:26.611643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0445d5aa-530f-4b1f-af7c-6559c65ff23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:26.658762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:26.678363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 367/736] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:50:26 2022] POST /identity/v3/services => generated 251 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:26.679658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515d39e-ce76-4f85-acfc-72c303262f72 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:26.694272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:26.702392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 370/737] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:26 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:26.703678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445d5aa-530f-4b1f-af7c-6559c65ff23f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:26.851766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0445d5aa-530f-4b1f-af7c-6559c65ff23f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:26.858359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515d39e-ce76-4f85-acfc-72c303262f72 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:26.900355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4fa30-02f6-41b9-a107-39baceca3c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:26.901586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4fa30-02f6-41b9-a107-39baceca3c55 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.901862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4fa30-02f6-41b9-a107-39baceca3c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.902877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4fa30-02f6-41b9-a107-39baceca3c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.903941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a34fd-f6c6-4259-8ad0-35289373ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:26.904801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a34fd-f6c6-4259-8ad0-35289373ab8d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.905082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a34fd-f6c6-4259-8ad0-35289373ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.905356 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a34fd-f6c6-4259-8ad0-35289373ab8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.914355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4fa30-02f6-41b9-a107-39baceca3c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:26.915823 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4fa30-02f6-41b9-a107-39baceca3c55 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:26.916535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a34fd-f6c6-4259-8ad0-35289373ab8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:26.917984 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a34fd-f6c6-4259-8ad0-35289373ab8d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-33a4fa30-02f6-41b9-a107-39baceca3c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:26.935331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:26.936540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:26.942521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:26.942521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:26.942521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:26.942521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e82a34fd-f6c6-4259-8ad0-35289373ab8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:26.942750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:26.943549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:26.944533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:26.944533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:26.944533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:26.944533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:26.944751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 371/738] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:26.944821 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 368/739] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:26.944888 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4fa30-02f6-41b9-a107-39baceca3c55 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:26.946342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53790-f225-41e5-b31d-7e1b7a3c67e1 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:26.946629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53790-f225-41e5-b31d-7e1b7a3c67e1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:26.946903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff53790-f225-41e5-b31d-7e1b7a3c67e1 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:26.949150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 369/740] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:26 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:26.949906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff53790-f225-41e5-b31d-7e1b7a3c67e1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:26.976857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:27.029422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:27.053293 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4fa30-02f6-41b9-a107-39baceca3c55 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:27.077344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff53790-f225-41e5-b31d-7e1b7a3c67e1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:27.093601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921602-38b8-40af-b080-90e16517ab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:27.094398 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921602-38b8-40af-b080-90e16517ab32 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:27.094684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921602-38b8-40af-b080-90e16517ab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:27.094957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3921602-38b8-40af-b080-90e16517ab32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:27.105823 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3921602-38b8-40af-b080-90e16517ab32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:27.111813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a9901-0d00-4592-b178-01858a9566f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:27.112521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a9901-0d00-4592-b178-01858a9566f0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:27.112799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a9901-0d00-4592-b178-01858a9566f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:27.113074 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a9901-0d00-4592-b178-01858a9566f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-b3921602-38b8-40af-b080-90e16517ab32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:27.113353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:27.114252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:27.115110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:27.115752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a9901-0d00-4592-b178-01858a9566f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:27.115752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a9901-0d00-4592-b178-01858a9566f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:27.115883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 372/741] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:27.115883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921602-38b8-40af-b080-90e16517ab32 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:27.120620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59a9901-0d00-4592-b178-01858a9566f0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:27.138338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 370/742] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:27.139736 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b9e3c-8cc4-4267-a155-e8de2ae33bbd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:27.140048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b9e3c-8cc4-4267-a155-e8de2ae33bbd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:27.140381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36b9e3c-8cc4-4267-a155-e8de2ae33bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:27.156904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b36b9e3c-8cc4-4267-a155-e8de2ae33bbd None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:27.158086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b36b9e3c-8cc4-4267-a155-e8de2ae33bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:27.212795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:27.226106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3921602-38b8-40af-b080-90e16517ab32 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:27.240319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 371/743] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:27 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 20 21:50:27.240319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b9e3c-8cc4-4267-a155-e8de2ae33bbd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:27.267809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8b35d-e545-4786-a124-7e93c9a8d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:27.268492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8b35d-e545-4786-a124-7e93c9a8d4ad None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:27.268851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8b35d-e545-4786-a124-7e93c9a8d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:27.269128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb8b35d-e545-4786-a124-7e93c9a8d4ad None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:27.269840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8b35d-e545-4786-a124-7e93c9a8d4ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:27.270142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8b35d-e545-4786-a124-7e93c9a8d4ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:27.271499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb8b35d-e545-4786-a124-7e93c9a8d4ad None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:27.286883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 373/744] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:27.287552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8b35d-e545-4786-a124-7e93c9a8d4ad None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:27.308426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:27.367873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36b9e3c-8cc4-4267-a155-e8de2ae33bbd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:27.391426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb8b35d-e545-4786-a124-7e93c9a8d4ad None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:27.403868 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cbd94-8387-487c-a764-1f871db7938c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:27.404571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbd94-8387-487c-a764-1f871db7938c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:27.404860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbd94-8387-487c-a764-1f871db7938c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:27.405116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cbd94-8387-487c-a764-1f871db7938c None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:27.405860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cbd94-8387-487c-a764-1f871db7938c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:27.406162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cbd94-8387-487c-a764-1f871db7938c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:27.407519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33cbd94-8387-487c-a764-1f871db7938c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:27.420959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 372/745] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:27.420959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cbd94-8387-487c-a764-1f871db7938c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:27.437937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb48553-c4c2-4084-870d-9a9fbb5d20ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:27.438730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb48553-c4c2-4084-870d-9a9fbb5d20ec None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:27.439001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb48553-c4c2-4084-870d-9a9fbb5d20ec None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:27.439265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb48553-c4c2-4084-870d-9a9fbb5d20ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:27.446245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb48553-c4c2-4084-870d-9a9fbb5d20ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:27.447817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb48553-c4c2-4084-870d-9a9fbb5d20ec None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-cdb48553-c4c2-4084-870d-9a9fbb5d20ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:27.461843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:27.462748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:27.463798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:27.463798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:27.463798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:27.463798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:27.463798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:27.463798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:27.463798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:27.463798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:27.463798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 374/746] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:27.463798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb48553-c4c2-4084-870d-9a9fbb5d20ec None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:27.475192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:27.534786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cbd94-8387-487c-a764-1f871db7938c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:27.550273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:27.569875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb48553-c4c2-4084-870d-9a9fbb5d20ec None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:27.570851 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac9fe9-ea4c-4468-923c-9795d3bb981e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:27.571573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac9fe9-ea4c-4468-923c-9795d3bb981e None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:27.571975 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac9fe9-ea4c-4468-923c-9795d3bb981e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:27.572253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ac9fe9-ea4c-4468-923c-9795d3bb981e None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:27.573043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac9fe9-ea4c-4468-923c-9795d3bb981e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:27.574407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ac9fe9-ea4c-4468-923c-9795d3bb981e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:27.605121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08aba7-0388-4294-b1bd-a96557754439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:27.606499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08aba7-0388-4294-b1bd-a96557754439 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:27.607010 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08aba7-0388-4294-b1bd-a96557754439 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:27.607513 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08aba7-0388-4294-b1bd-a96557754439 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:27.616088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08aba7-0388-4294-b1bd-a96557754439 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:27.617534 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c08aba7-0388-4294-b1bd-a96557754439 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3c08aba7-0388-4294-b1bd-a96557754439 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:27.632007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:27.633167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:27.634110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 375/747] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Jul 20 21:50:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:27.643168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08aba7-0388-4294-b1bd-a96557754439 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:27.700956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 373/748] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:50:27 2022] POST /identity/v3/services => generated 240 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:27.702012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac9fe9-ea4c-4468-923c-9795d3bb981e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:27.727319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:27.780141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08aba7-0388-4294-b1bd-a96557754439 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:27.841347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6cd7d-2e35-4e88-9d5a-baed952bfdc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:27.842255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ac9fe9-ea4c-4468-923c-9795d3bb981e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:27.842632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6cd7d-2e35-4e88-9d5a-baed952bfdc2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:27.843063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6cd7d-2e35-4e88-9d5a-baed952bfdc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:27.843514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e6cd7d-2e35-4e88-9d5a-baed952bfdc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:27.862385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6cd7d-2e35-4e88-9d5a-baed952bfdc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:27.864842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e6cd7d-2e35-4e88-9d5a-baed952bfdc2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:27.886925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ca419-fb67-4b87-93f5-8c988bc1efb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:27.887611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ca419-fb67-4b87-93f5-8c988bc1efb7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:27.888073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ca419-fb67-4b87-93f5-8c988bc1efb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:27.888412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ca419-fb67-4b87-93f5-8c988bc1efb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:27.889297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ca419-fb67-4b87-93f5-8c988bc1efb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:27.889612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ca419-fb67-4b87-93f5-8c988bc1efb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-28e6cd7d-2e35-4e88-9d5a-baed952bfdc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:27.890260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:27.891380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:27.892344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:27.892344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:27.892344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:27.892344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:27.892581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ca419-fb67-4b87-93f5-8c988bc1efb7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:27.896649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 376/749] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:27.897072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6cd7d-2e35-4e88-9d5a-baed952bfdc2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:27.911698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 374/750] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:27.912857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ca419-fb67-4b87-93f5-8c988bc1efb7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:27.951344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:28.030166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e6cd7d-2e35-4e88-9d5a-baed952bfdc2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:28.041003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ca419-fb67-4b87-93f5-8c988bc1efb7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:28.048721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:28.068515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a8cd5-6ac3-409f-8214-5c50a74426e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:28.069214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a8cd5-6ac3-409f-8214-5c50a74426e7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:28.069522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a8cd5-6ac3-409f-8214-5c50a74426e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:28.069802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8a8cd5-6ac3-409f-8214-5c50a74426e7 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:28.070776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a8cd5-6ac3-409f-8214-5c50a74426e7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:28.071515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a8cd5-6ac3-409f-8214-5c50a74426e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:28.074052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8a8cd5-6ac3-409f-8214-5c50a74426e7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:28.081939 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186447c4-3e93-4c30-9906-fe408e31afca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:28.082797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186447c4-3e93-4c30-9906-fe408e31afca None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:28.083247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186447c4-3e93-4c30-9906-fe408e31afca None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:28.083673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186447c4-3e93-4c30-9906-fe408e31afca None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:28.084686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186447c4-3e93-4c30-9906-fe408e31afca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:28.085262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186447c4-3e93-4c30-9906-fe408e31afca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:28.086624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186447c4-3e93-4c30-9906-fe408e31afca None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:28.096621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 377/751] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Jul 20 21:50:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:28.097803 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a8cd5-6ac3-409f-8214-5c50a74426e7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:28.104243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 375/752] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:28.105102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186447c4-3e93-4c30-9906-fe408e31afca None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:28.214043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:28.224925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186447c4-3e93-4c30-9906-fe408e31afca None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:28.236806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8a8cd5-6ac3-409f-8214-5c50a74426e7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:28.261999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b49a16-4027-4216-9002-b4067bab8d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:28.262662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b49a16-4027-4216-9002-b4067bab8d61 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:28.262948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b49a16-4027-4216-9002-b4067bab8d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:28.263233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b49a16-4027-4216-9002-b4067bab8d61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:28.268407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef189-c04a-4fa9-b481-459f436f3044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:28.269253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef189-c04a-4fa9-b481-459f436f3044 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:28.269686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef189-c04a-4fa9-b481-459f436f3044 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:28.270132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ef189-c04a-4fa9-b481-459f436f3044 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:28.271137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ef189-c04a-4fa9-b481-459f436f3044 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=dff5a11076ea426a8bf760bfee7a5023) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:28.271596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ef189-c04a-4fa9-b481-459f436f3044 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:28.273268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ef189-c04a-4fa9-b481-459f436f3044 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:28.280303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 378/753] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:28 2022] GET /identity/v3/role_assignments?user.id=dff5a11076ea426a8bf760bfee7a5023&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:28.281503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef189-c04a-4fa9-b481-459f436f3044 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:28.330846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:28.370488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b49a16-4027-4216-9002-b4067bab8d61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:28.372012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b49a16-4027-4216-9002-b4067bab8d61 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:28.404659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ef189-c04a-4fa9-b481-459f436f3044 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:28.461783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b58bfc-9dfb-406d-8be3-d9a40705cbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:28.462604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b58bfc-9dfb-406d-8be3-d9a40705cbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:28.462892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b58bfc-9dfb-406d-8be3-d9a40705cbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:28.463363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b58bfc-9dfb-406d-8be3-d9a40705cbd3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:28.476368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b58bfc-9dfb-406d-8be3-d9a40705cbd3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:28.477682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b58bfc-9dfb-406d-8be3-d9a40705cbd3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:28.479742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:28.502962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 376/754] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:28 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:50:28.507773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b49a16-4027-4216-9002-b4067bab8d61 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-35b58bfc-9dfb-406d-8be3-d9a40705cbd3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:28.518264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:28.519247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:28.520328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 379/755] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Jul 20 21:50:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:28.527118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b58bfc-9dfb-406d-8be3-d9a40705cbd3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:28.656718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:28.660885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b58bfc-9dfb-406d-8be3-d9a40705cbd3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:28.672999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b49a16-4027-4216-9002-b4067bab8d61 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:28.712629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d7d7-b157-4643-a134-1d908a051b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:28.713352 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d7d7-b157-4643-a134-1d908a051b9a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:28.713953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d7d7-b157-4643-a134-1d908a051b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:28.714334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0d7d7-b157-4643-a134-1d908a051b9a None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:28.715255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0d7d7-b157-4643-a134-1d908a051b9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:28.715578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0d7d7-b157-4643-a134-1d908a051b9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:28.717046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0d7d7-b157-4643-a134-1d908a051b9a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:28.730299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cef570-f4a2-4204-b22a-d174f7296dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:28.731114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cef570-f4a2-4204-b22a-d174f7296dbb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:28.731399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cef570-f4a2-4204-b22a-d174f7296dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:28.731678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cef570-f4a2-4204-b22a-d174f7296dbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:28.737012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 380/756] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Jul 20 21:50:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:28.742170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d7d7-b157-4643-a134-1d908a051b9a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:28.743327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cef570-f4a2-4204-b22a-d174f7296dbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:28.745511 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cef570-f4a2-4204-b22a-d174f7296dbb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-03cef570-f4a2-4204-b22a-d174f7296dbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:28.766860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:28.767894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:28.768811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:28.768811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:28.768811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:28.768811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:28.768811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 377/757] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:28.775228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cef570-f4a2-4204-b22a-d174f7296dbb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:28.853598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0d7d7-b157-4643-a134-1d908a051b9a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:28.889631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:28.911217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d64873-417e-4775-af01-cd8f55f8cfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:28.912269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d64873-417e-4775-af01-cd8f55f8cfbe None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:28.912683 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d64873-417e-4775-af01-cd8f55f8cfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:28.913078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d64873-417e-4775-af01-cd8f55f8cfbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:28.934174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d64873-417e-4775-af01-cd8f55f8cfbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:28.935875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d64873-417e-4775-af01-cd8f55f8cfbe None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-48d64873-417e-4775-af01-cd8f55f8cfbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:28.967767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:28.968911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:28.970010 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:28.970010 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:28.970010 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:28.970010 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:28.970284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 381/758] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:28.975196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524b6e-9f0e-4885-ad44-a93b0242f794 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:28.976068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524b6e-9f0e-4885-ad44-a93b0242f794 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:28.976530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21524b6e-9f0e-4885-ad44-a93b0242f794 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:28.978325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 382/759] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:28.979862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524b6e-9f0e-4885-ad44-a93b0242f794 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:28.991253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:28.995207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cef570-f4a2-4204-b22a-d174f7296dbb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:29.037073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99c5c2-1235-4fb7-8c83-3a1a67f56270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:29.037892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99c5c2-1235-4fb7-8c83-3a1a67f56270 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:29.038274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99c5c2-1235-4fb7-8c83-3a1a67f56270 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:29.038671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99c5c2-1235-4fb7-8c83-3a1a67f56270 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:29.039597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99c5c2-1235-4fb7-8c83-3a1a67f56270 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:29.040031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99c5c2-1235-4fb7-8c83-3a1a67f56270 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:29.042172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99c5c2-1235-4fb7-8c83-3a1a67f56270 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:29.054901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 378/760] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:29.060909 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91391ba-58ef-4a81-aaa6-b53c6580fe06 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:29.061303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91391ba-58ef-4a81-aaa6-b53c6580fe06 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:29.061775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91391ba-58ef-4a81-aaa6-b53c6580fe06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:29.080408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c91391ba-58ef-4a81-aaa6-b53c6580fe06 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:29.081809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c91391ba-58ef-4a81-aaa6-b53c6580fe06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:29.108422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21524b6e-9f0e-4885-ad44-a93b0242f794 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:29.155654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d51e2-4a8e-4f3d-8b78-a79402b4b07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:29.156582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d51e2-4a8e-4f3d-8b78-a79402b4b07b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:29.157001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d51e2-4a8e-4f3d-8b78-a79402b4b07b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:29.157412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d51e2-4a8e-4f3d-8b78-a79402b4b07b None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:29.157796 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 379/761] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:29.158447 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d51e2-4a8e-4f3d-8b78-a79402b4b07b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:29.158882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d51e2-4a8e-4f3d-8b78-a79402b4b07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:29.159067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91391ba-58ef-4a81-aaa6-b53c6580fe06 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:29.160619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d51e2-4a8e-4f3d-8b78-a79402b4b07b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:29.176768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 383/762] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:29.182806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d51e2-4a8e-4f3d-8b78-a79402b4b07b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:29.199883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:29.259865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:29.295672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91391ba-58ef-4a81-aaa6-b53c6580fe06 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:29.299823 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d51e2-4a8e-4f3d-8b78-a79402b4b07b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:29.335733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a48ff-af5c-4ecf-8a9f-d74a1afe15b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:29.336690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a48ff-af5c-4ecf-8a9f-d74a1afe15b8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:29.337116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a48ff-af5c-4ecf-8a9f-d74a1afe15b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:29.337455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a48ff-af5c-4ecf-8a9f-d74a1afe15b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:29.343200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e19b54-305b-4a2d-b5a7-24b9f6f3d409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:29.344321 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19b54-305b-4a2d-b5a7-24b9f6f3d409 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:29.344747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19b54-305b-4a2d-b5a7-24b9f6f3d409 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:29.345346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19b54-305b-4a2d-b5a7-24b9f6f3d409 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:29.346281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a48ff-af5c-4ecf-8a9f-d74a1afe15b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:29.348022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010a48ff-af5c-4ecf-8a9f-d74a1afe15b8 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:29.354354 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e19b54-305b-4a2d-b5a7-24b9f6f3d409 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:29.356498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e19b54-305b-4a2d-b5a7-24b9f6f3d409 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-010a48ff-af5c-4ecf-8a9f-d74a1afe15b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:29.363510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:29.364590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:29.365675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:29.365675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:29.365675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:29.365675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:29.365675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:29.365675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:29.365675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:29.365675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:29.372094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 384/763] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:29.373014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a48ff-af5c-4ecf-8a9f-d74a1afe15b8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a6e19b54-305b-4a2d-b5a7-24b9f6f3d409 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:29.373836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:29.374850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:29.375943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:29.375943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:29.375943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:29.375943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:29.375943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:29.375943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:29.375943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:29.375943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:29.378049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 380/764] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:29.379007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e19b54-305b-4a2d-b5a7-24b9f6f3d409 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:29.492311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:29.498811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e19b54-305b-4a2d-b5a7-24b9f6f3d409 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:29.504129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a48ff-af5c-4ecf-8a9f-d74a1afe15b8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:29.537091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:29.537473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4348-9a65-4783-a3c4-5b49f1ed17c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:29.539123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4348-9a65-4783-a3c4-5b49f1ed17c1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:29.539610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4348-9a65-4783-a3c4-5b49f1ed17c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:29.540322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a4348-9a65-4783-a3c4-5b49f1ed17c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:29.541346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a4348-9a65-4783-a3c4-5b49f1ed17c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:29.541804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a4348-9a65-4783-a3c4-5b49f1ed17c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:29.543708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47a4348-9a65-4783-a3c4-5b49f1ed17c1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:29.545175 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea5a35-2477-400b-b135-e0ce9e5484d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:29.546075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea5a35-2477-400b-b135-e0ce9e5484d0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:29.546454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea5a35-2477-400b-b135-e0ce9e5484d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:29.546824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea5a35-2477-400b-b135-e0ce9e5484d0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:29.547754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea5a35-2477-400b-b135-e0ce9e5484d0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:29.549066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea5a35-2477-400b-b135-e0ce9e5484d0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-61ea5a35-2477-400b-b135-e0ce9e5484d0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:29.565029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:29.566276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:29.567552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 385/765] 10.222.0.85 () {56 vars in 1129 bytes} [Wed Jul 20 21:50:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:29.568710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea5a35-2477-400b-b135-e0ce9e5484d0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:29.569050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 381/766] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:29.570047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4348-9a65-4783-a3c4-5b49f1ed17c1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:29.671125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea5a35-2477-400b-b135-e0ce9e5484d0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:29.681477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a4348-9a65-4783-a3c4-5b49f1ed17c1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:29.709258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166fa27-751d-4003-8f07-0bc518b0fcd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:29.710605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166fa27-751d-4003-8f07-0bc518b0fcd0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:29.711282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166fa27-751d-4003-8f07-0bc518b0fcd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:29.711725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166fa27-751d-4003-8f07-0bc518b0fcd0 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:29.712847 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166fa27-751d-4003-8f07-0bc518b0fcd0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:29.713344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166fa27-751d-4003-8f07-0bc518b0fcd0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:29.715656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166fa27-751d-4003-8f07-0bc518b0fcd0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:29.725514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd8298-c4ae-4bca-8a97-75a6e084a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:29.726533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd8298-c4ae-4bca-8a97-75a6e084a521 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:29.726908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd8298-c4ae-4bca-8a97-75a6e084a521 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:29.727281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd8298-c4ae-4bca-8a97-75a6e084a521 None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/5e192a50b09b49b4b7db2508ecf75af5/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:29.730620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd8298-c4ae-4bca-8a97-75a6e084a521 None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=5e192a50b09b49b4b7db2508ecf75af5, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:29.735970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd8298-c4ae-4bca-8a97-75a6e084a521 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:29.736142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 386/767] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:29.737027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166fa27-751d-4003-8f07-0bc518b0fcd0 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:29.795088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:29.822774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 382/768] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:50:29 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/5e192a50b09b49b4b7db2508ecf75af5/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:50:29.825023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd8298-c4ae-4bca-8a97-75a6e084a521 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:29.845120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166fa27-751d-4003-8f07-0bc518b0fcd0 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:29.846873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:30.000619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b8936-30e7-4736-843f-2b682c5e32db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:30.001781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b8936-30e7-4736-843f-2b682c5e32db None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.002076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b8936-30e7-4736-843f-2b682c5e32db None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.004627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b8936-30e7-4736-843f-2b682c5e32db None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.004627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b8936-30e7-4736-843f-2b682c5e32db None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:30.004627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b8936-30e7-4736-843f-2b682c5e32db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:30.005086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0b8936-30e7-4736-843f-2b682c5e32db None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:30.015106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 387/769] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Jul 20 21:50:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:30.021281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b8936-30e7-4736-843f-2b682c5e32db None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:30.050438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd8298-c4ae-4bca-8a97-75a6e084a521 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:30.094899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1635567-4db2-40fa-8205-3f5646c92d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:30.095570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1635567-4db2-40fa-8205-3f5646c92d29 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.095853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1635567-4db2-40fa-8205-3f5646c92d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.096152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1635567-4db2-40fa-8205-3f5646c92d29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.096995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1635567-4db2-40fa-8205-3f5646c92d29 None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=864f16bb01df4ea3866ed68b7f0eb0da) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:30.097305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1635567-4db2-40fa-8205-3f5646c92d29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:30.098904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1635567-4db2-40fa-8205-3f5646c92d29 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:30.108929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 383/770] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:29 2022] GET /identity/v3/role_assignments?user.id=864f16bb01df4ea3866ed68b7f0eb0da&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:30.181695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b8936-30e7-4736-843f-2b682c5e32db None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:30.208159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:30.238829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bd04c0-52a8-4a7c-8617-8dd543cc8598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:30.239514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd04c0-52a8-4a7c-8617-8dd543cc8598 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.239795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd04c0-52a8-4a7c-8617-8dd543cc8598 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.240102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bd04c0-52a8-4a7c-8617-8dd543cc8598 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.240835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd04c0-52a8-4a7c-8617-8dd543cc8598 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:30.241144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd04c0-52a8-4a7c-8617-8dd543cc8598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:30.242573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bd04c0-52a8-4a7c-8617-8dd543cc8598 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:30.252710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 388/771] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Jul 20 21:50:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:30.259086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1635567-4db2-40fa-8205-3f5646c92d29 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:30.311782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e48244-ca5d-4999-a0bc-0969cb035cc3 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.312108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e48244-ca5d-4999-a0bc-0969cb035cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.312284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e48244-ca5d-4999-a0bc-0969cb035cc3 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.313904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 389/772] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:30.321595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd15d6f-cc94-413b-b540-7afd1d78958f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.321896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd15d6f-cc94-413b-b540-7afd1d78958f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.322349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd15d6f-cc94-413b-b540-7afd1d78958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.345948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fcd15d6f-cc94-413b-b540-7afd1d78958f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:30.347527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fcd15d6f-cc94-413b-b540-7afd1d78958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:30.387277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:30.419448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1635567-4db2-40fa-8205-3f5646c92d29 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:30.479030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 390/773] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:30.485268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8f616-9fdc-4eff-8edf-4b1220b93833 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.485545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8f616-9fdc-4eff-8edf-4b1220b93833 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.485821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb8f616-9fdc-4eff-8edf-4b1220b93833 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.487583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 391/774] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:30.488456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca74850-999e-4aca-a870-9bb3e767c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:30.489442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca74850-999e-4aca-a870-9bb3e767c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.489926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca74850-999e-4aca-a870-9bb3e767c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.490443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca74850-999e-4aca-a870-9bb3e767c0e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.491465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca74850-999e-4aca-a870-9bb3e767c0e1 None admin] RBAC: Adding query filter params (interface=public, service_id=0cca3cfcfeb146a8a447a58aef570918, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:30.492007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca74850-999e-4aca-a870-9bb3e767c0e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:30.493581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca74850-999e-4aca-a870-9bb3e767c0e1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:30.497296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b403e30-792e-407f-9435-a233ec568e0a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.497581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b403e30-792e-407f-9435-a233ec568e0a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.497858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b403e30-792e-407f-9435-a233ec568e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.504158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 384/775] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Jul 20 21:50:30 2022] GET /identity/v3/endpoints?service_id=0cca3cfcfeb146a8a447a58aef570918&interface=public®ion_id=RegionOne => generated 194 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:30.514188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca74850-999e-4aca-a870-9bb3e767c0e1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:30.523697 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5b403e30-792e-407f-9435-a233ec568e0a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:30.524908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5b403e30-792e-407f-9435-a233ec568e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:30.624080 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 392/776] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:30.625471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b403e30-792e-407f-9435-a233ec568e0a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:30.649395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca74850-999e-4aca-a870-9bb3e767c0e1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:30.685729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827b25-58b1-4ce6-95db-738c8ef8e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:30.686370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:30.687656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827b25-58b1-4ce6-95db-738c8ef8e736 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.688188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827b25-58b1-4ce6-95db-738c8ef8e736 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.688721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72827b25-58b1-4ce6-95db-738c8ef8e736 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.689614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72827b25-58b1-4ce6-95db-738c8ef8e736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:30.691225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72827b25-58b1-4ce6-95db-738c8ef8e736 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:30.697102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 385/777] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Jul 20 21:50:30 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:30.698847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827b25-58b1-4ce6-95db-738c8ef8e736 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:30.716412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:30.767248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b403e30-792e-407f-9435-a233ec568e0a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:30.819553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b746b60-ce34-47f5-acd8-23beddc4fe7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:30.820398 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b746b60-ce34-47f5-acd8-23beddc4fe7d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.820676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b746b60-ce34-47f5-acd8-23beddc4fe7d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.820948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b746b60-ce34-47f5-acd8-23beddc4fe7d None admin] PATH_INFO: `/v3/services/network` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.821621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b746b60-ce34-47f5-acd8-23beddc4fe7d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:30.823086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b746b60-ce34-47f5-acd8-23beddc4fe7d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:30.827191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72827b25-58b1-4ce6-95db-738c8ef8e736 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-7b746b60-ce34-47f5-acd8-23beddc4fe7d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:30.851359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:30.852678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:30.853540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 393/778] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:30 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:30.866989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b746b60-ce34-47f5-acd8-23beddc4fe7d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:30.897770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75a603-128e-4cfd-b1c0-3a14a1b32ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:30.899790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75a603-128e-4cfd-b1c0-3a14a1b32ba1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:30.900089 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75a603-128e-4cfd-b1c0-3a14a1b32ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:30.900361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75a603-128e-4cfd-b1c0-3a14a1b32ba1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:30.921741 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75a603-128e-4cfd-b1c0-3a14a1b32ba1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3d75a603-128e-4cfd-b1c0-3a14a1b32ba1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:30.929553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:30.930499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:30.931405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 386/779] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:30.938636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75a603-128e-4cfd-b1c0-3a14a1b32ba1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:31.019156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:31.030105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b746b60-ce34-47f5-acd8-23beddc4fe7d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:31.032758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:31.072775 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb061-5cdf-432f-b5b4-6ecebeba3a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:31.073752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb061-5cdf-432f-b5b4-6ecebeba3a1e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:31.074234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb061-5cdf-432f-b5b4-6ecebeba3a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:31.074498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75a603-128e-4cfd-b1c0-3a14a1b32ba1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:31.075126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bddb061-5cdf-432f-b5b4-6ecebeba3a1e None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:31.076024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb061-5cdf-432f-b5b4-6ecebeba3a1e None admin] RBAC: Adding query filter params (name=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:31.076468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb061-5cdf-432f-b5b4-6ecebeba3a1e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:31.079329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bddb061-5cdf-432f-b5b4-6ecebeba3a1e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:31.085405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 394/780] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:31.091841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb061-5cdf-432f-b5b4-6ecebeba3a1e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:31.157701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9174cd4-64c9-44d9-99b7-9dbb8c9ba987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:31.158707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9174cd4-64c9-44d9-99b7-9dbb8c9ba987 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:31.159238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9174cd4-64c9-44d9-99b7-9dbb8c9ba987 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:31.159726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9174cd4-64c9-44d9-99b7-9dbb8c9ba987 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:31.160756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9174cd4-64c9-44d9-99b7-9dbb8c9ba987 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:31.162597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9174cd4-64c9-44d9-99b7-9dbb8c9ba987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:31.164237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9174cd4-64c9-44d9-99b7-9dbb8c9ba987 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:31.188702 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 387/781] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:31.189909 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9174cd4-64c9-44d9-99b7-9dbb8c9ba987 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:31.316754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bddb061-5cdf-432f-b5b4-6ecebeba3a1e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:31.396665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeef127-9797-4966-ba64-462d305ad07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:31.398590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeef127-9797-4966-ba64-462d305ad07f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:31.400350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeef127-9797-4966-ba64-462d305ad07f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:31.401380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeef127-9797-4966-ba64-462d305ad07f None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:31.402570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeef127-9797-4966-ba64-462d305ad07f None admin] RBAC: Adding query filter params (type=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:31.404249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeef127-9797-4966-ba64-462d305ad07f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:31.406119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeef127-9797-4966-ba64-462d305ad07f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:31.417317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9174cd4-64c9-44d9-99b7-9dbb8c9ba987 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:31.424013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 395/782] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:31.433236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeef127-9797-4966-ba64-462d305ad07f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:31.484858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:31.496283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:31.505018 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24cdf5-ae12-44e9-8ba8-008789431867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:31.505944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24cdf5-ae12-44e9-8ba8-008789431867 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:31.507090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24cdf5-ae12-44e9-8ba8-008789431867 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:31.509497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24cdf5-ae12-44e9-8ba8-008789431867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:31.533539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24cdf5-ae12-44e9-8ba8-008789431867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:31.539420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af24cdf5-ae12-44e9-8ba8-008789431867 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-af24cdf5-ae12-44e9-8ba8-008789431867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:31.578193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:31.579187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:31.580105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:31.580105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:31.580105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:31.580105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:31.582877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 388/783] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:31.587374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24cdf5-ae12-44e9-8ba8-008789431867 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:31.643978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeef127-9797-4966-ba64-462d305ad07f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:31.719505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872a177-b5f8-462e-ad5e-2f7f6b0c85f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:31.723699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a177-b5f8-462e-ad5e-2f7f6b0c85f1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:31.724085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a177-b5f8-462e-ad5e-2f7f6b0c85f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:31.724431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872a177-b5f8-462e-ad5e-2f7f6b0c85f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:31.725306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a177-b5f8-462e-ad5e-2f7f6b0c85f1 None admin] RBAC: Adding query filter params (interface=public, service_id=dd5883ff0cda43ea9b971197f32724ab, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:31.725694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a177-b5f8-462e-ad5e-2f7f6b0c85f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:31.728284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872a177-b5f8-462e-ad5e-2f7f6b0c85f1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:31.754304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 396/784] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Jul 20 21:50:31 2022] GET /identity/v3/endpoints?service_id=dd5883ff0cda43ea9b971197f32724ab&interface=public®ion_id=RegionOne => generated 194 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:31.763760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872a177-b5f8-462e-ad5e-2f7f6b0c85f1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:31.808913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24cdf5-ae12-44e9-8ba8-008789431867 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:31.895126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db0e2a-ea34-4404-94f9-df30541b7809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:31.895804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db0e2a-ea34-4404-94f9-df30541b7809 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:31.896114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db0e2a-ea34-4404-94f9-df30541b7809 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:31.896395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61db0e2a-ea34-4404-94f9-df30541b7809 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:31.897135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db0e2a-ea34-4404-94f9-df30541b7809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:31.897445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db0e2a-ea34-4404-94f9-df30541b7809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:31.898874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61db0e2a-ea34-4404-94f9-df30541b7809 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:31.932091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 389/785] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:31.936971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db0e2a-ea34-4404-94f9-df30541b7809 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:31.984070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:31.993008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:32.014650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872a177-b5f8-462e-ad5e-2f7f6b0c85f1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:32.055898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61db0e2a-ea34-4404-94f9-df30541b7809 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:32.096568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b45ed-77d4-4b45-bb55-b37920da562b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:32.098056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b45ed-77d4-4b45-bb55-b37920da562b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.098556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b45ed-77d4-4b45-bb55-b37920da562b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.099032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b45ed-77d4-4b45-bb55-b37920da562b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.107479 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b45ed-77d4-4b45-bb55-b37920da562b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:32.109301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b45ed-77d4-4b45-bb55-b37920da562b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ba2b45ed-77d4-4b45-bb55-b37920da562b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:32.126644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:32.127651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:32.128624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:32.128624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:32.128624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:32.128624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:32.128624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:32.128624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:32.128624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:32.128624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:32.128624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:32.128624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:32.131393 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 390/786] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:32.141979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b45ed-77d4-4b45-bb55-b37920da562b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:32.143663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260329-a459-4922-80cb-2701ed5d3c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:32.144370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260329-a459-4922-80cb-2701ed5d3c04 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.144655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260329-a459-4922-80cb-2701ed5d3c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.144928 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260329-a459-4922-80cb-2701ed5d3c04 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.145624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260329-a459-4922-80cb-2701ed5d3c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:32.147010 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260329-a459-4922-80cb-2701ed5d3c04 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:32.169928 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 397/787] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Jul 20 21:50:31 2022] GET /identity/v3/services => generated 772 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:32.358016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:32.361666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b45ed-77d4-4b45-bb55-b37920da562b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:32.410782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438bf7a-948f-4088-9e27-7eb60f6c992f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:32.411461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438bf7a-948f-4088-9e27-7eb60f6c992f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.411746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438bf7a-948f-4088-9e27-7eb60f6c992f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.412041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438bf7a-948f-4088-9e27-7eb60f6c992f None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.412884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438bf7a-948f-4088-9e27-7eb60f6c992f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:32.413191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438bf7a-948f-4088-9e27-7eb60f6c992f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:32.414641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438bf7a-948f-4088-9e27-7eb60f6c992f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:32.417173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e2a2-206b-45c3-a6ce-9fdb90303cdc None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.417458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e2a2-206b-45c3-a6ce-9fdb90303cdc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.417729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9e2a2-206b-45c3-a6ce-9fdb90303cdc None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.419349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 398/788] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:32.425225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ba6d-a5ad-424f-8389-e75405af8b58 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.425510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ba6d-a5ad-424f-8389-e75405af8b58 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.425784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2073ba6d-a5ad-424f-8389-e75405af8b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.436223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 391/789] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Jul 20 21:50:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:32.442263 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438bf7a-948f-4088-9e27-7eb60f6c992f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:32.445514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2073ba6d-a5ad-424f-8389-e75405af8b58 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:32.446706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2073ba6d-a5ad-424f-8389-e75405af8b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:32.542966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 399/790] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:32.544857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf56e3-0527-4fed-a34d-6fe04ca0d7e9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.545151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf56e3-0527-4fed-a34d-6fe04ca0d7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.545426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbf56e3-0527-4fed-a34d-6fe04ca0d7e9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.546973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 400/791] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:32.569371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e646e-8d77-41cd-963f-ffccca44b416 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.569735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e646e-8d77-41cd-963f-ffccca44b416 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.570070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e646e-8d77-41cd-963f-ffccca44b416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.584688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438bf7a-948f-4088-9e27-7eb60f6c992f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:32.586829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-410e646e-8d77-41cd-963f-ffccca44b416 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:32.588203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-410e646e-8d77-41cd-963f-ffccca44b416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:32.623960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e2cf1-ca0c-402b-8681-9da11a2af16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:32.624705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2cf1-ca0c-402b-8681-9da11a2af16a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.624990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2cf1-ca0c-402b-8681-9da11a2af16a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.625265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023e2cf1-ca0c-402b-8681-9da11a2af16a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.636772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e2cf1-ca0c-402b-8681-9da11a2af16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:32.638298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023e2cf1-ca0c-402b-8681-9da11a2af16a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-023e2cf1-ca0c-402b-8681-9da11a2af16a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:32.657167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:32.658090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:32.658958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:32.658958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:32.658958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:32.658958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:32.658958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 392/792] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:32.659756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e2cf1-ca0c-402b-8681-9da11a2af16a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:32.665514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 401/793] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:32.667139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e646e-8d77-41cd-963f-ffccca44b416 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:32.677718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:32.690011 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:32.771894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e646e-8d77-41cd-963f-ffccca44b416 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:32.797192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023e2cf1-ca0c-402b-8681-9da11a2af16a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:32.809310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2648e-c586-4a96-9cc3-97e160b88e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:32.810249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2648e-c586-4a96-9cc3-97e160b88e0a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.810694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2648e-c586-4a96-9cc3-97e160b88e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.811464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2648e-c586-4a96-9cc3-97e160b88e0a None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.812360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2648e-c586-4a96-9cc3-97e160b88e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:32.812806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2648e-c586-4a96-9cc3-97e160b88e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:32.814334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2648e-c586-4a96-9cc3-97e160b88e0a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:32.827269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 402/794] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:32.832993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2648e-c586-4a96-9cc3-97e160b88e0a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:32.835725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8f599-d807-46dc-b759-a00721960f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:32.836561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8f599-d807-46dc-b759-a00721960f67 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.836846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8f599-d807-46dc-b759-a00721960f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.837123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f8f599-d807-46dc-b759-a00721960f67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.850300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f8f599-d807-46dc-b759-a00721960f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-16f8f599-d807-46dc-b759-a00721960f67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:32.859328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:32.860520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:32.861524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:32.865674 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 393/795] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:32.866383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8f599-d807-46dc-b759-a00721960f67 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:32.925711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:32.939887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:32.948522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2648e-c586-4a96-9cc3-97e160b88e0a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:32.979372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f8f599-d807-46dc-b759-a00721960f67 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:32.986646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e95ca-670e-40e8-beeb-61e7efb84a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:32.987862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e95ca-670e-40e8-beeb-61e7efb84a19 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:32.988307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e95ca-670e-40e8-beeb-61e7efb84a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:32.988718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e95ca-670e-40e8-beeb-61e7efb84a19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:32.999773 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e95ca-670e-40e8-beeb-61e7efb84a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a01e95ca-670e-40e8-beeb-61e7efb84a19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:33.007861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:33.008990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:33.010042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:33.012273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 403/796] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:33.013174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e95ca-670e-40e8-beeb-61e7efb84a19 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:33.024084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa2f24-a1cd-473e-b7c1-0981d2f88d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:33.024894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa2f24-a1cd-473e-b7c1-0981d2f88d3b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.025179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa2f24-a1cd-473e-b7c1-0981d2f88d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.026342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa2f24-a1cd-473e-b7c1-0981d2f88d3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.033988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa2f24-a1cd-473e-b7c1-0981d2f88d3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:33.035592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa2f24-a1cd-473e-b7c1-0981d2f88d3b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-00fa2f24-a1cd-473e-b7c1-0981d2f88d3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:33.052664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:33.053793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:33.054806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:33.054806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:33.054806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:33.054806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:33.054806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:33.054806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:33.054806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:33.054806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:33.058292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 394/797] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:33.059240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa2f24-a1cd-473e-b7c1-0981d2f88d3b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:33.124038 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e95ca-670e-40e8-beeb-61e7efb84a19 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:33.159873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759365b-6d6b-4551-8809-5fef594710ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:33.160848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759365b-6d6b-4551-8809-5fef594710ba None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.161294 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759365b-6d6b-4551-8809-5fef594710ba None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.161709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d759365b-6d6b-4551-8809-5fef594710ba None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.162592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759365b-6d6b-4551-8809-5fef594710ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:33.163035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759365b-6d6b-4551-8809-5fef594710ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:33.164559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d759365b-6d6b-4551-8809-5fef594710ba None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:33.172923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa2f24-a1cd-473e-b7c1-0981d2f88d3b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:33.174151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 404/798] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:33.175117 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759365b-6d6b-4551-8809-5fef594710ba None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:33.178879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:33.209104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:33.218558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d66a23-6b61-4d7b-aaf9-f66dd1908fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:33.219473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d66a23-6b61-4d7b-aaf9-f66dd1908fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.219939 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d66a23-6b61-4d7b-aaf9-f66dd1908fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.220384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d66a23-6b61-4d7b-aaf9-f66dd1908fd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.221279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d66a23-6b61-4d7b-aaf9-f66dd1908fd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:33.223140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d66a23-6b61-4d7b-aaf9-f66dd1908fd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:33.225976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d66a23-6b61-4d7b-aaf9-f66dd1908fd8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:33.241569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 395/799] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:33.242679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d66a23-6b61-4d7b-aaf9-f66dd1908fd8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:33.281802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d759365b-6d6b-4551-8809-5fef594710ba None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:33.316807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f325a-7cd6-4ace-887d-1148c38b61d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:33.317454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f325a-7cd6-4ace-887d-1148c38b61d2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.317732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f325a-7cd6-4ace-887d-1148c38b61d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.318002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f325a-7cd6-4ace-887d-1148c38b61d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.318783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f325a-7cd6-4ace-887d-1148c38b61d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:33.319085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f325a-7cd6-4ace-887d-1148c38b61d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:33.320554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f325a-7cd6-4ace-887d-1148c38b61d2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:33.335808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 405/800] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:33.336897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f325a-7cd6-4ace-887d-1148c38b61d2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:33.358123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d66a23-6b61-4d7b-aaf9-f66dd1908fd8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:33.394747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c5d80a-11cd-4deb-a7ec-04371617c14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:33.395537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5d80a-11cd-4deb-a7ec-04371617c14b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.395815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5d80a-11cd-4deb-a7ec-04371617c14b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.396110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c5d80a-11cd-4deb-a7ec-04371617c14b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.406180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:33.408715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5d80a-11cd-4deb-a7ec-04371617c14b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:33.410045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c5d80a-11cd-4deb-a7ec-04371617c14b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b7c5d80a-11cd-4deb-a7ec-04371617c14b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:33.427715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:33.428752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:33.429733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:33.429733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:33.429733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:33.429733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:33.429733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 396/801] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:33.430553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3699a5-15c0-4441-93bc-a73904831e12 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.430843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3699a5-15c0-4441-93bc-a73904831e12 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.431120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3699a5-15c0-4441-93bc-a73904831e12 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.435969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 397/802] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:33.435969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3699a5-15c0-4441-93bc-a73904831e12 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:33.457606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f325a-7cd6-4ace-887d-1148c38b61d2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:33.488149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:33.495185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d555638-d6bd-48a5-a558-1f16f9dbd5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:33.496136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d555638-d6bd-48a5-a558-1f16f9dbd5ce None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.496444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d555638-d6bd-48a5-a558-1f16f9dbd5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.496722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d555638-d6bd-48a5-a558-1f16f9dbd5ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.507543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d555638-d6bd-48a5-a558-1f16f9dbd5ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:33.509007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d555638-d6bd-48a5-a558-1f16f9dbd5ce None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4d555638-d6bd-48a5-a558-1f16f9dbd5ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:33.530078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:33.531095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:33.532798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:33.532798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:33.532798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:33.532798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:33.532798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 406/803] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:33.532798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d555638-d6bd-48a5-a558-1f16f9dbd5ce None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:33.559767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3699a5-15c0-4441-93bc-a73904831e12 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:33.599630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588bc0-fd59-4d31-bb9a-601515e0e03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:33.600723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588bc0-fd59-4d31-bb9a-601515e0e03e None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.601106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588bc0-fd59-4d31-bb9a-601515e0e03e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.601478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa588bc0-fd59-4d31-bb9a-601515e0e03e None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/dff5a11076ea426a8bf760bfee7a5023/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.603572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa588bc0-fd59-4d31-bb9a-601515e0e03e None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=dff5a11076ea426a8bf760bfee7a5023, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:33.605585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa588bc0-fd59-4d31-bb9a-601515e0e03e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:33.637166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d555638-d6bd-48a5-a558-1f16f9dbd5ce None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:33.651380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:33.671090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2321761b-aded-4ab8-aa54-32c967ce56db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:33.671748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321761b-aded-4ab8-aa54-32c967ce56db None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.672061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321761b-aded-4ab8-aa54-32c967ce56db None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.672342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2321761b-aded-4ab8-aa54-32c967ce56db None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.673063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321761b-aded-4ab8-aa54-32c967ce56db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:33.673372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321761b-aded-4ab8-aa54-32c967ce56db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:33.674804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2321761b-aded-4ab8-aa54-32c967ce56db None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:33.691452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 407/805] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:33.691452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a380b52-5f32-4b05-b39a-95a15a63432c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.691452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a380b52-5f32-4b05-b39a-95a15a63432c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.691452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a380b52-5f32-4b05-b39a-95a15a63432c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.695631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 398/805] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:50:33 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/dff5a11076ea426a8bf760bfee7a5023/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:50:33.698519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588bc0-fd59-4d31-bb9a-601515e0e03e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:33.717999 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5a380b52-5f32-4b05-b39a-95a15a63432c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:33.719551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5a380b52-5f32-4b05-b39a-95a15a63432c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:33.807348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 408/806] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:33.809004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a380b52-5f32-4b05-b39a-95a15a63432c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:33.841519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa588bc0-fd59-4d31-bb9a-601515e0e03e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:33.843604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:33.892894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7a722-ce69-4ab3-8efd-625c4be33526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:33.893563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a722-ce69-4ab3-8efd-625c4be33526 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.893852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a722-ce69-4ab3-8efd-625c4be33526 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.894505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e7a722-ce69-4ab3-8efd-625c4be33526 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:33.895232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7a722-ce69-4ab3-8efd-625c4be33526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:33.895881 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7a722-ce69-4ab3-8efd-625c4be33526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:33.898114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e7a722-ce69-4ab3-8efd-625c4be33526 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:33.910743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 399/807] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:33.911495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7a722-ce69-4ab3-8efd-625c4be33526 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:33.939843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a380b52-5f32-4b05-b39a-95a15a63432c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:33.943281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:33.988449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478ade0-8ed6-4d36-93c0-b1ff495e299b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:33.989241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478ade0-8ed6-4d36-93c0-b1ff495e299b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:33.989519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478ade0-8ed6-4d36-93c0-b1ff495e299b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:33.989791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7478ade0-8ed6-4d36-93c0-b1ff495e299b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.000159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478ade0-8ed6-4d36-93c0-b1ff495e299b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:34.002081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7478ade0-8ed6-4d36-93c0-b1ff495e299b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-7478ade0-8ed6-4d36-93c0-b1ff495e299b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:34.020806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:34.021982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:34.023027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 409/808] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Jul 20 21:50:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:34.023710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478ade0-8ed6-4d36-93c0-b1ff495e299b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:34.031657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e7a722-ce69-4ab3-8efd-625c4be33526 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:34.074304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e19aa-80c1-4d04-9909-ec8639cda1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:34.075250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e19aa-80c1-4d04-9909-ec8639cda1a6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:34.075536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e19aa-80c1-4d04-9909-ec8639cda1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:34.079940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e19aa-80c1-4d04-9909-ec8639cda1a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.079940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e19aa-80c1-4d04-9909-ec8639cda1a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:34.079940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4e19aa-80c1-4d04-9909-ec8639cda1a6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5c4e19aa-80c1-4d04-9909-ec8639cda1a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:34.099101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:34.100214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:34.101170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 400/809] 10.222.0.85 () {56 vars in 1129 bytes} [Wed Jul 20 21:50:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:34.102241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e19aa-80c1-4d04-9909-ec8639cda1a6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:34.139294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:34.150675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7478ade0-8ed6-4d36-93c0-b1ff495e299b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:34.190378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267ad91-1efa-4397-8aca-d45b8097d69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:34.191639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267ad91-1efa-4397-8aca-d45b8097d69f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:34.192212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267ad91-1efa-4397-8aca-d45b8097d69f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:34.192698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4267ad91-1efa-4397-8aca-d45b8097d69f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.201891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267ad91-1efa-4397-8aca-d45b8097d69f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:34.203829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4267ad91-1efa-4397-8aca-d45b8097d69f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4267ad91-1efa-4397-8aca-d45b8097d69f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:34.220688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:34.221712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:34.222691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:34.222691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:34.222691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:34.222691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:34.222691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:34.222691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:34.222691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:34.222691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:34.222691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:34.222691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:34.232036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e19aa-80c1-4d04-9909-ec8639cda1a6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:34.232397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 410/810] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Jul 20 21:50:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:34.233744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267ad91-1efa-4397-8aca-d45b8097d69f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:34.264526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:34.273676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33a116-99ac-4b14-a4b3-34a0431c4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:34.276011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a116-99ac-4b14-a4b3-34a0431c4ebc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:34.276543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a116-99ac-4b14-a4b3-34a0431c4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:34.278570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d33a116-99ac-4b14-a4b3-34a0431c4ebc None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.278570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33a116-99ac-4b14-a4b3-34a0431c4ebc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:34.278570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33a116-99ac-4b14-a4b3-34a0431c4ebc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:34.280235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d33a116-99ac-4b14-a4b3-34a0431c4ebc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:34.307353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 401/811] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Jul 20 21:50:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:34.308515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33a116-99ac-4b14-a4b3-34a0431c4ebc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:34.351415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4267ad91-1efa-4397-8aca-d45b8097d69f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:34.389574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfa5a6-c03d-4797-a17b-299d31f46d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:34.390262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfa5a6-c03d-4797-a17b-299d31f46d2f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:34.390794 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfa5a6-c03d-4797-a17b-299d31f46d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:34.391064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfa5a6-c03d-4797-a17b-299d31f46d2f None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.391770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfa5a6-c03d-4797-a17b-299d31f46d2f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:34.392102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfa5a6-c03d-4797-a17b-299d31f46d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:34.393459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cfa5a6-c03d-4797-a17b-299d31f46d2f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:34.398327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 411/812] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Jul 20 21:50:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:34.399108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfa5a6-c03d-4797-a17b-299d31f46d2f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:34.417483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:34.433539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d33a116-99ac-4b14-a4b3-34a0431c4ebc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:34.470947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d258ab-1308-4cc3-82af-3b1d52ee02d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:34.471615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d258ab-1308-4cc3-82af-3b1d52ee02d3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:34.471891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d258ab-1308-4cc3-82af-3b1d52ee02d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:34.472189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d258ab-1308-4cc3-82af-3b1d52ee02d3 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.473012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d258ab-1308-4cc3-82af-3b1d52ee02d3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:34.473319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d258ab-1308-4cc3-82af-3b1d52ee02d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:34.474745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d258ab-1308-4cc3-82af-3b1d52ee02d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:34.493396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 402/813] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Jul 20 21:50:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:34.494883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:34.496898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2fafc-134b-420b-ae2e-33e2959404af None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:34.497443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2fafc-134b-420b-ae2e-33e2959404af None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:34.497863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2fafc-134b-420b-ae2e-33e2959404af None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.499284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 403/814] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:34.500194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2fafc-134b-420b-ae2e-33e2959404af None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:34.511442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfa5a6-c03d-4797-a17b-299d31f46d2f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:34.548798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63196c4b-535f-403b-8c62-87c869a0e080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:34.549575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63196c4b-535f-403b-8c62-87c869a0e080 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:34.549852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63196c4b-535f-403b-8c62-87c869a0e080 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:34.550121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63196c4b-535f-403b-8c62-87c869a0e080 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.607531 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2fafc-134b-420b-ae2e-33e2959404af None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:34.622277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63196c4b-535f-403b-8c62-87c869a0e080 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:34.623867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63196c4b-535f-403b-8c62-87c869a0e080 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:34.643866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd3246-db0c-48b6-ad7d-2ad5c313f896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:34.644603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd3246-db0c-48b6-ad7d-2ad5c313f896 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:34.644884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd3246-db0c-48b6-ad7d-2ad5c313f896 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:34.645159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd3246-db0c-48b6-ad7d-2ad5c313f896 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.645861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd3246-db0c-48b6-ad7d-2ad5c313f896 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:34.646165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd3246-db0c-48b6-ad7d-2ad5c313f896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:34.647655 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd3246-db0c-48b6-ad7d-2ad5c313f896 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:34.657605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 404/815] 10.222.0.85 () {56 vars in 1124 bytes} [Wed Jul 20 21:50:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:34.657605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd3246-db0c-48b6-ad7d-2ad5c313f896 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:34.666561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:34.722701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:34.735832 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 412/816] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:50:34.737586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71622f6-4201-42ab-9b5d-604f642d83d0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:34.738017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71622f6-4201-42ab-9b5d-604f642d83d0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:34.738416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71622f6-4201-42ab-9b5d-604f642d83d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.756756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d71622f6-4201-42ab-9b5d-604f642d83d0 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:34.757953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d71622f6-4201-42ab-9b5d-604f642d83d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:34.770404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd3246-db0c-48b6-ad7d-2ad5c313f896 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:34.811264 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96d255-6a3b-4c72-bb33-dda4557b800a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:34.812371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96d255-6a3b-4c72-bb33-dda4557b800a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:34.813028 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96d255-6a3b-4c72-bb33-dda4557b800a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:34.813306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96d255-6a3b-4c72-bb33-dda4557b800a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:34.824342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96d255-6a3b-4c72-bb33-dda4557b800a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:34.826155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96d255-6a3b-4c72-bb33-dda4557b800a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:34.836437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 413/817] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:34.836437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71622f6-4201-42ab-9b5d-604f642d83d0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4f96d255-6a3b-4c72-bb33-dda4557b800a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:34.847549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:34.848669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:34.849556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:34.849556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:34.849556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:34.849556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:34.854841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 405/818] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:34.855745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96d255-6a3b-4c72-bb33-dda4557b800a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:34.924387 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:34.957614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71622f6-4201-42ab-9b5d-604f642d83d0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:34.974244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96d255-6a3b-4c72-bb33-dda4557b800a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:34.980536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:34.998772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8be25-923d-46d8-83f4-c3f57eddb275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:34.999571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8be25-923d-46d8-83f4-c3f57eddb275 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:35.000029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8be25-923d-46d8-83f4-c3f57eddb275 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:35.000303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc8be25-923d-46d8-83f4-c3f57eddb275 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:35.001039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8be25-923d-46d8-83f4-c3f57eddb275 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:35.002385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc8be25-923d-46d8-83f4-c3f57eddb275 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:35.012243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25340c02-cb5a-4c1b-af97-12c7f24fe70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:35.013187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25340c02-cb5a-4c1b-af97-12c7f24fe70b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:35.013498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25340c02-cb5a-4c1b-af97-12c7f24fe70b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:35.013750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25340c02-cb5a-4c1b-af97-12c7f24fe70b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:35.024025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25340c02-cb5a-4c1b-af97-12c7f24fe70b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:35.026164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25340c02-cb5a-4c1b-af97-12c7f24fe70b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-25340c02-cb5a-4c1b-af97-12c7f24fe70b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:35.044120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:35.050442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:35.051370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:35.051370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:35.051370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:35.051370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:35.051370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 406/819] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:35.051370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25340c02-cb5a-4c1b-af97-12c7f24fe70b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:35.119960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 414/820] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Jul 20 21:50:34 2022] POST /identity/v3/endpoints => generated 346 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:35.119960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8be25-923d-46d8-83f4-c3f57eddb275 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:35.162229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25340c02-cb5a-4c1b-af97-12c7f24fe70b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:35.298597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:35.336159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b2a36-48f4-4335-a97a-7540cc438f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:35.336830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b2a36-48f4-4335-a97a-7540cc438f8a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:35.337113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b2a36-48f4-4335-a97a-7540cc438f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:35.337415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b2a36-48f4-4335-a97a-7540cc438f8a None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:35.338729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b2a36-48f4-4335-a97a-7540cc438f8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:35.339030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b2a36-48f4-4335-a97a-7540cc438f8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:35.340448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b2a36-48f4-4335-a97a-7540cc438f8a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:35.357886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 407/821] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:35.357886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b2a36-48f4-4335-a97a-7540cc438f8a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:35.375014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc8be25-923d-46d8-83f4-c3f57eddb275 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:35.414146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac2bb2-8c68-4034-9516-7f7863fe4fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:35.414942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac2bb2-8c68-4034-9516-7f7863fe4fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:35.415278 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac2bb2-8c68-4034-9516-7f7863fe4fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:35.415552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bac2bb2-8c68-4034-9516-7f7863fe4fd9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:35.416459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac2bb2-8c68-4034-9516-7f7863fe4fd9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:35.417870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bac2bb2-8c68-4034-9516-7f7863fe4fd9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9bac2bb2-8c68-4034-9516-7f7863fe4fd9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:35.438492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:35.439551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 20 21:50:35.440464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:35.444001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 415/822] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:35 2022] GET /identity/v3/services/network => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:35.445064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac2bb2-8c68-4034-9516-7f7863fe4fd9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:35.488384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b2a36-48f4-4335-a97a-7540cc438f8a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:35.497463 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:35.529720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc97a54-cd06-4fb9-9740-a5fed4a4b400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:35.530409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc97a54-cd06-4fb9-9740-a5fed4a4b400 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:35.530661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc97a54-cd06-4fb9-9740-a5fed4a4b400 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:35.530933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc97a54-cd06-4fb9-9740-a5fed4a4b400 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:35.531657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc97a54-cd06-4fb9-9740-a5fed4a4b400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:35.532013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc97a54-cd06-4fb9-9740-a5fed4a4b400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:35.533477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc97a54-cd06-4fb9-9740-a5fed4a4b400 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:35.553328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 408/823] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:35.553328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc97a54-cd06-4fb9-9740-a5fed4a4b400 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:35.577431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bac2bb2-8c68-4034-9516-7f7863fe4fd9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:35.588778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:35.614448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a40e34-234c-4493-9879-56636401176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:35.615236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40e34-234c-4493-9879-56636401176b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:35.615521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40e34-234c-4493-9879-56636401176b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:35.615795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a40e34-234c-4493-9879-56636401176b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:35.623639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a40e34-234c-4493-9879-56636401176b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:35.625151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a40e34-234c-4493-9879-56636401176b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-75a40e34-234c-4493-9879-56636401176b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:35.639761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:35.640974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:35.641874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:35.641874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:35.641874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:35.641874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:35.641874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:35.641874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:35.641874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:35.641874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:35.646871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 416/824] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:35.647587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a40e34-234c-4493-9879-56636401176b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:35.683195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc97a54-cd06-4fb9-9740-a5fed4a4b400 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:35.718940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359f0fd-ea26-4b73-80e7-8017d397750e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:35.719620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359f0fd-ea26-4b73-80e7-8017d397750e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:35.719901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359f0fd-ea26-4b73-80e7-8017d397750e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:35.720214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4359f0fd-ea26-4b73-80e7-8017d397750e None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:35.720925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359f0fd-ea26-4b73-80e7-8017d397750e None admin] RBAC: Adding query filter params (name=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:35.721292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359f0fd-ea26-4b73-80e7-8017d397750e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:35.722718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4359f0fd-ea26-4b73-80e7-8017d397750e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:35.727767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 409/825] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:35.732853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359f0fd-ea26-4b73-80e7-8017d397750e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:35.767260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a40e34-234c-4493-9879-56636401176b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:35.788330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:35.802889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b42f6-f3f7-43d5-b244-a41fce407c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:35.804880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b42f6-f3f7-43d5-b244-a41fce407c89 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:35.804880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b42f6-f3f7-43d5-b244-a41fce407c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:35.804880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b42f6-f3f7-43d5-b244-a41fce407c89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:35.813339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b42f6-f3f7-43d5-b244-a41fce407c89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:35.815046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896b42f6-f3f7-43d5-b244-a41fce407c89 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-896b42f6-f3f7-43d5-b244-a41fce407c89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:35.834760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:35.844890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:35.845785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:35.845785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:35.845785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:35.845785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:35.845785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:35.845785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:35.845785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:35.845785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:35.846241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:35.846241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4359f0fd-ea26-4b73-80e7-8017d397750e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:35.846399 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 417/826] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:35.846399 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b42f6-f3f7-43d5-b244-a41fce407c89 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:35.878980 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42bfe8-67d3-4d9c-8cce-08588dfedd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:35.879650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42bfe8-67d3-4d9c-8cce-08588dfedd50 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:35.879969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42bfe8-67d3-4d9c-8cce-08588dfedd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:35.881621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f42bfe8-67d3-4d9c-8cce-08588dfedd50 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:35.882234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42bfe8-67d3-4d9c-8cce-08588dfedd50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:35.882551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42bfe8-67d3-4d9c-8cce-08588dfedd50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:35.884087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f42bfe8-67d3-4d9c-8cce-08588dfedd50 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:35.902636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 410/827] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:35.903693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42bfe8-67d3-4d9c-8cce-08588dfedd50 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:35.972596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b42f6-f3f7-43d5-b244-a41fce407c89 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:36.011582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a717c2-df70-4a06-a2a2-b48f1410c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:36.012280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a717c2-df70-4a06-a2a2-b48f1410c52b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:36.012561 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a717c2-df70-4a06-a2a2-b48f1410c52b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:36.012831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a717c2-df70-4a06-a2a2-b48f1410c52b None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:36.013543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a717c2-df70-4a06-a2a2-b48f1410c52b None admin] RBAC: Adding query filter params (type=network) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:36.013846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a717c2-df70-4a06-a2a2-b48f1410c52b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:36.015210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a717c2-df70-4a06-a2a2-b48f1410c52b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:36.024914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 418/828] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:36.024914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cd805-9c4c-49ce-8e61-db457c09d7ad None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:36.024914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cd805-9c4c-49ce-8e61-db457c09d7ad None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:36.024914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69cd805-9c4c-49ce-8e61-db457c09d7ad None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:36.024914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 419/829] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:36.024914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cd805-9c4c-49ce-8e61-db457c09d7ad None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:36.038423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f42bfe8-67d3-4d9c-8cce-08588dfedd50 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:36.051112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:36.075813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920b3b1-bdf7-4feb-819a-06bbcc8e2d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:36.076523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b3b1-bdf7-4feb-819a-06bbcc8e2d6d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:36.076809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b3b1-bdf7-4feb-819a-06bbcc8e2d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:36.077086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b3b1-bdf7-4feb-819a-06bbcc8e2d6d None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:36.077875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b3b1-bdf7-4feb-819a-06bbcc8e2d6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:36.078185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b3b1-bdf7-4feb-819a-06bbcc8e2d6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:36.079663 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b3b1-bdf7-4feb-819a-06bbcc8e2d6d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:36.098638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 411/830] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:36.098638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920b3b1-bdf7-4feb-819a-06bbcc8e2d6d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:36.110049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:36.139107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69cd805-9c4c-49ce-8e61-db457c09d7ad None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:36.174109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599caab9-0671-412b-adc9-aac30730624e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:36.174982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599caab9-0671-412b-adc9-aac30730624e None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:36.175258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599caab9-0671-412b-adc9-aac30730624e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:36.175524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599caab9-0671-412b-adc9-aac30730624e None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/864f16bb01df4ea3866ed68b7f0eb0da/roles/917334e4be884c77a974784c424ccde3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:36.190633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599caab9-0671-412b-adc9-aac30730624e None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=864f16bb01df4ea3866ed68b7f0eb0da, role_id=917334e4be884c77a974784c424ccde3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:36.192085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599caab9-0671-412b-adc9-aac30730624e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:36.207047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920b3b1-bdf7-4feb-819a-06bbcc8e2d6d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:36.241844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f603eef-56bf-4a3f-8782-77c109a41afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:36.242491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f603eef-56bf-4a3f-8782-77c109a41afe None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:36.242765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f603eef-56bf-4a3f-8782-77c109a41afe None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:36.243032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f603eef-56bf-4a3f-8782-77c109a41afe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:36.243758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f603eef-56bf-4a3f-8782-77c109a41afe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:36.245295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f603eef-56bf-4a3f-8782-77c109a41afe None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:36.277880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 420/831] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:50:36 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/864f16bb01df4ea3866ed68b7f0eb0da/roles/917334e4be884c77a974784c424ccde3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:50:36.279423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f25e33-bfa9-4867-97dd-23453c1e6d80 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:36.279859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f25e33-bfa9-4867-97dd-23453c1e6d80 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:36.280326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f25e33-bfa9-4867-97dd-23453c1e6d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:36.303649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-19f25e33-bfa9-4867-97dd-23453c1e6d80 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:36.305250 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-19f25e33-bfa9-4867-97dd-23453c1e6d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:36.368478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 412/832] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Jul 20 21:50:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:36.370454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f603eef-56bf-4a3f-8782-77c109a41afe None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:36.407205 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:36.423736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 421/833] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:36.451776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f25e33-bfa9-4867-97dd-23453c1e6d80 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:36.503295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:36.552123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f603eef-56bf-4a3f-8782-77c109a41afe None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:36.600406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9642ac6-02db-490a-8bb9-e3cb3d52e375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:36.601064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9642ac6-02db-490a-8bb9-e3cb3d52e375 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:36.601347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9642ac6-02db-490a-8bb9-e3cb3d52e375 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:36.601886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9642ac6-02db-490a-8bb9-e3cb3d52e375 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:36.602444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9642ac6-02db-490a-8bb9-e3cb3d52e375 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=5e192a50b09b49b4b7db2508ecf75af5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:36.602752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9642ac6-02db-490a-8bb9-e3cb3d52e375 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:36.605541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9642ac6-02db-490a-8bb9-e3cb3d52e375 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:36.610180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f25e33-bfa9-4867-97dd-23453c1e6d80 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:36.615972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 413/834] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:36 2022] GET /identity/v3/role_assignments?user.id=5e192a50b09b49b4b7db2508ecf75af5&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 608 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:36.657963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2cfe9-77f6-4b56-824f-ff8c8d18205e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:36.658700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2cfe9-77f6-4b56-824f-ff8c8d18205e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:36.658980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2cfe9-77f6-4b56-824f-ff8c8d18205e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:36.659251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e2cfe9-77f6-4b56-824f-ff8c8d18205e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:36.673480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e2cfe9-77f6-4b56-824f-ff8c8d18205e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-26e2cfe9-77f6-4b56-824f-ff8c8d18205e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:36.681488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:36.682484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:50:36.683392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:36.684071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 422/835] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:36.689645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9642ac6-02db-490a-8bb9-e3cb3d52e375 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:36.804951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9642ac6-02db-490a-8bb9-e3cb3d52e375 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:36.836337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:36.843203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7bcc9-31ea-4aae-8cdc-d1bd05b615b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:36.843894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7bcc9-31ea-4aae-8cdc-d1bd05b615b7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:36.844200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7bcc9-31ea-4aae-8cdc-d1bd05b615b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:36.844471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf7bcc9-31ea-4aae-8cdc-d1bd05b615b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:36.845274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7bcc9-31ea-4aae-8cdc-d1bd05b615b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:36.845578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7bcc9-31ea-4aae-8cdc-d1bd05b615b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:36.846956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf7bcc9-31ea-4aae-8cdc-d1bd05b615b7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:36.857482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 414/836] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:36.863060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2cfe9-77f6-4b56-824f-ff8c8d18205e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:36.933650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:36.976980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e2cfe9-77f6-4b56-824f-ff8c8d18205e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:37.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddba0a4-63b1-4ce0-88a9-dcc96f16275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:37.022600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddba0a4-63b1-4ce0-88a9-dcc96f16275f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:37.022880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddba0a4-63b1-4ce0-88a9-dcc96f16275f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:37.023151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddba0a4-63b1-4ce0-88a9-dcc96f16275f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:37.034256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddba0a4-63b1-4ce0-88a9-dcc96f16275f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:37.035694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddba0a4-63b1-4ce0-88a9-dcc96f16275f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-bddba0a4-63b1-4ce0-88a9-dcc96f16275f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:37.053802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:37.054723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:37.055650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:37.055650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:37.055650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:37.055650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:37.055650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 423/837] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:37.061700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7bcc9-31ea-4aae-8cdc-d1bd05b615b7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:37.175679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf7bcc9-31ea-4aae-8cdc-d1bd05b615b7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:37.212462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66603af5-c822-40ab-bd32-c89b70bb831c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:37.213630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66603af5-c822-40ab-bd32-c89b70bb831c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:37.213905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66603af5-c822-40ab-bd32-c89b70bb831c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:37.214178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66603af5-c822-40ab-bd32-c89b70bb831c None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:37.214905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66603af5-c822-40ab-bd32-c89b70bb831c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:37.215204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66603af5-c822-40ab-bd32-c89b70bb831c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:37.216600 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66603af5-c822-40ab-bd32-c89b70bb831c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:37.229675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 415/838] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:37.235193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddba0a4-63b1-4ce0-88a9-dcc96f16275f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:37.340920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddba0a4-63b1-4ce0-88a9-dcc96f16275f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:37.351450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:37.374264 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea74b9-a089-499e-9d7e-5057c799eab5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:37.374551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea74b9-a089-499e-9d7e-5057c799eab5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:37.374828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea74b9-a089-499e-9d7e-5057c799eab5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:37.376611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 416/839] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:37.380196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5d490-f81b-4c9f-9aba-d7204c145231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:37.381001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5d490-f81b-4c9f-9aba-d7204c145231 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:37.381282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5d490-f81b-4c9f-9aba-d7204c145231 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:37.381556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f5d490-f81b-4c9f-9aba-d7204c145231 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:37.384306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7c5a0-8cab-415b-94ed-7b38952cffad None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:37.384659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7c5a0-8cab-415b-94ed-7b38952cffad None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:37.385452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7c5a0-8cab-415b-94ed-7b38952cffad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:37.391582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5d490-f81b-4c9f-9aba-d7204c145231 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:37.393391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f5d490-f81b-4c9f-9aba-d7204c145231 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:37.404380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-57c7c5a0-8cab-415b-94ed-7b38952cffad None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:37.405855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-57c7c5a0-8cab-415b-94ed-7b38952cffad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-88f5d490-f81b-4c9f-9aba-d7204c145231 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:37.407825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:37.408927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:37.414806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 424/840] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:50:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:37.417594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5d490-f81b-4c9f-9aba-d7204c145231 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:37.466541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:37.488043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 417/841] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:37.511208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7c5a0-8cab-415b-94ed-7b38952cffad None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:37.534871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f5d490-f81b-4c9f-9aba-d7204c145231 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:37.571586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe4ba0-6d01-4e63-a446-556737463fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:37.572978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe4ba0-6d01-4e63-a446-556737463fca None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:37.573383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe4ba0-6d01-4e63-a446-556737463fca None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:37.573666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbe4ba0-6d01-4e63-a446-556737463fca None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:37.574758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe4ba0-6d01-4e63-a446-556737463fca None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:37.575066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe4ba0-6d01-4e63-a446-556737463fca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:37.577214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbe4ba0-6d01-4e63-a446-556737463fca None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:37.601701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 425/842] 10.222.0.85 () {56 vars in 1135 bytes} [Wed Jul 20 21:50:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:37.607241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe4ba0-6d01-4e63-a446-556737463fca None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:37.621625 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7c5a0-8cab-415b-94ed-7b38952cffad None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:37.641174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:37.661265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b806-93f9-4fd0-bd12-e7deaa5188da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:37.662420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b806-93f9-4fd0-bd12-e7deaa5188da None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:37.662904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b806-93f9-4fd0-bd12-e7deaa5188da None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:37.663401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1b806-93f9-4fd0-bd12-e7deaa5188da None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:37.664327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b806-93f9-4fd0-bd12-e7deaa5188da None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:37.666484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1b806-93f9-4fd0-bd12-e7deaa5188da None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9bf1b806-93f9-4fd0-bd12-e7deaa5188da None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:37.679481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:37.680915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 21:50:37.683190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:37.686986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 418/843] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:50:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:37.695438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b806-93f9-4fd0-bd12-e7deaa5188da None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:37.750992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbe4ba0-6d01-4e63-a446-556737463fca None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:37.753752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:37.797791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f5dfb-a8eb-4260-bd11-c02b50cdcf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:37.798473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f5dfb-a8eb-4260-bd11-c02b50cdcf6c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:37.798754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f5dfb-a8eb-4260-bd11-c02b50cdcf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:37.799028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2f5dfb-a8eb-4260-bd11-c02b50cdcf6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:37.815445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1b806-93f9-4fd0-bd12-e7deaa5188da None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:37.866389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f38eca-6793-4959-a614-ef2c2431fd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:37.866389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f38eca-6793-4959-a614-ef2c2431fd8d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:37.866389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f38eca-6793-4959-a614-ef2c2431fd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:37.866389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f38eca-6793-4959-a614-ef2c2431fd8d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:37.866822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f38eca-6793-4959-a614-ef2c2431fd8d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:37.866822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f38eca-6793-4959-a614-ef2c2431fd8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:37.866822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f38eca-6793-4959-a614-ef2c2431fd8d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:37.872038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 419/844] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:50:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:37.877710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f38eca-6793-4959-a614-ef2c2431fd8d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:37.887071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f5dfb-a8eb-4260-bd11-c02b50cdcf6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:37.888631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2f5dfb-a8eb-4260-bd11-c02b50cdcf6c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:37.920306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:38.016345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 426/845] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 21:50:38.017175 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f5dfb-a8eb-4260-bd11-c02b50cdcf6c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:38.018132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f38eca-6793-4959-a614-ef2c2431fd8d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:38.031606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:38.061845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a2ccb-b674-43cd-aaba-f51a784c5e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:38.062905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a2ccb-b674-43cd-aaba-f51a784c5e7c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.063756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a2ccb-b674-43cd-aaba-f51a784c5e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.064271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505a2ccb-b674-43cd-aaba-f51a784c5e7c None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.065739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a2ccb-b674-43cd-aaba-f51a784c5e7c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:38.066289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a2ccb-b674-43cd-aaba-f51a784c5e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:38.068313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505a2ccb-b674-43cd-aaba-f51a784c5e7c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:38.080613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 420/846] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:50:37 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:38.139526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2f5dfb-a8eb-4260-bd11-c02b50cdcf6c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:38.170632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:38.179487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3944b-4c41-4bc4-bec7-697a00cbac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:38.184198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3944b-4c41-4bc4-bec7-697a00cbac03 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.184198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3944b-4c41-4bc4-bec7-697a00cbac03 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.184198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3944b-4c41-4bc4-bec7-697a00cbac03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.193220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3944b-4c41-4bc4-bec7-697a00cbac03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:38.194695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3944b-4c41-4bc4-bec7-697a00cbac03 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-77c3944b-4c41-4bc4-bec7-697a00cbac03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:38.215291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:38.216360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:38.217772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:38.217772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:38.217772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:38.217772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:38.217772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 427/847] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:38.222700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a2ccb-b674-43cd-aaba-f51a784c5e7c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:38.334456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505a2ccb-b674-43cd-aaba-f51a784c5e7c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:38.371509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aafb77-0644-444a-96a1-51e2624749c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:38.372205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aafb77-0644-444a-96a1-51e2624749c3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.372488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aafb77-0644-444a-96a1-51e2624749c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.372766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aafb77-0644-444a-96a1-51e2624749c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.373494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aafb77-0644-444a-96a1-51e2624749c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:38.373803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aafb77-0644-444a-96a1-51e2624749c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:38.375175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aafb77-0644-444a-96a1-51e2624749c3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:38.389061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 421/848] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:38.394803 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3944b-4c41-4bc4-bec7-697a00cbac03 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:38.503160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3944b-4c41-4bc4-bec7-697a00cbac03 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:38.542323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7a9a6-3f11-44bb-b60a-83fb668f79f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:38.543514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7a9a6-3f11-44bb-b60a-83fb668f79f9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.544033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7a9a6-3f11-44bb-b60a-83fb668f79f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.544524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7a9a6-3f11-44bb-b60a-83fb668f79f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.551845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7a9a6-3f11-44bb-b60a-83fb668f79f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:38.553522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7a9a6-3f11-44bb-b60a-83fb668f79f9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-58f7a9a6-3f11-44bb-b60a-83fb668f79f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:38.568287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:38.569244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:38.570138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:38.570138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:38.570138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:38.570138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:38.570138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:38.570138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:38.570138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:38.570138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:38.572726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 428/849] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:38.581344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aafb77-0644-444a-96a1-51e2624749c3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:38.592587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbd724-b0fd-4f38-8f5c-9ed2cc2d2a84 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.593420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbd724-b0fd-4f38-8f5c-9ed2cc2d2a84 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.593880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbd724-b0fd-4f38-8f5c-9ed2cc2d2a84 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.596268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 429/850] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:38.601083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb301bda-f2e6-4a87-a0d5-c4b44fb35e88 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.601372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb301bda-f2e6-4a87-a0d5-c4b44fb35e88 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.601647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb301bda-f2e6-4a87-a0d5-c4b44fb35e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.619069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:38.621255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fb301bda-f2e6-4a87-a0d5-c4b44fb35e88 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:38.622436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fb301bda-f2e6-4a87-a0d5-c4b44fb35e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:38.669906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:38.706665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aafb77-0644-444a-96a1-51e2624749c3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:38.712681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 430/851] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:38.737978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb301bda-f2e6-4a87-a0d5-c4b44fb35e88 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:38.759678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b47aee-b2e1-4adb-aae3-a7594c83424f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:38.761306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b47aee-b2e1-4adb-aae3-a7594c83424f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.761812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b47aee-b2e1-4adb-aae3-a7594c83424f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.762298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b47aee-b2e1-4adb-aae3-a7594c83424f None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.763720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b47aee-b2e1-4adb-aae3-a7594c83424f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:38.764275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b47aee-b2e1-4adb-aae3-a7594c83424f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:38.766574 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b47aee-b2e1-4adb-aae3-a7594c83424f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:38.785247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 422/852] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:38.792787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b47aee-b2e1-4adb-aae3-a7594c83424f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:38.872199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb301bda-f2e6-4a87-a0d5-c4b44fb35e88 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:38.908097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:38.910532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81990e9d-254e-483a-93c4-3e81c959a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:38.912047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990e9d-254e-483a-93c4-3e81c959a6bb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.912047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990e9d-254e-483a-93c4-3e81c959a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.912047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81990e9d-254e-483a-93c4-3e81c959a6bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.920962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b47aee-b2e1-4adb-aae3-a7594c83424f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:38.924063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81990e9d-254e-483a-93c4-3e81c959a6bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-81990e9d-254e-483a-93c4-3e81c959a6bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:38.931800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:38.933156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:38.934020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 431/853] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:50:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:38.935317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35d72-03c0-49e5-86e2-96fd0bdf1733 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.935317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35d72-03c0-49e5-86e2-96fd0bdf1733 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.935485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35d72-03c0-49e5-86e2-96fd0bdf1733 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.936831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 432/854] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:38.939951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad35d72-03c0-49e5-86e2-96fd0bdf1733 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:38.966632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb6574f-70bd-4fd3-a4f2-9761a4f9513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:38.967298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6574f-70bd-4fd3-a4f2-9761a4f9513a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.967584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6574f-70bd-4fd3-a4f2-9761a4f9513a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.967861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb6574f-70bd-4fd3-a4f2-9761a4f9513a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.968725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6574f-70bd-4fd3-a4f2-9761a4f9513a None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=dff5a11076ea426a8bf760bfee7a5023) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:38.969044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6574f-70bd-4fd3-a4f2-9761a4f9513a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:38.970481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb6574f-70bd-4fd3-a4f2-9761a4f9513a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:38.976659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 423/855] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:38 2022] GET /identity/v3/role_assignments?user.id=dff5a11076ea426a8bf760bfee7a5023&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:38.977137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:38.977962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a983b49-021a-46ce-a17e-b3b97d2c26a3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:38.978144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a983b49-021a-46ce-a17e-b3b97d2c26a3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:38.979094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a983b49-021a-46ce-a17e-b3b97d2c26a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:38.998261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8a983b49-021a-46ce-a17e-b3b97d2c26a3 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:38.998888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8a983b49-021a-46ce-a17e-b3b97d2c26a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:39.086930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 424/856] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:39.096105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad35d72-03c0-49e5-86e2-96fd0bdf1733 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:39.110149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a983b49-021a-46ce-a17e-b3b97d2c26a3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:39.148504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046df8e-8d04-4f9a-b33f-5bd2fe0fd77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:39.149625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046df8e-8d04-4f9a-b33f-5bd2fe0fd77c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:39.150190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046df8e-8d04-4f9a-b33f-5bd2fe0fd77c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:39.151018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046df8e-8d04-4f9a-b33f-5bd2fe0fd77c None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:39.151799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046df8e-8d04-4f9a-b33f-5bd2fe0fd77c None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:39.152156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046df8e-8d04-4f9a-b33f-5bd2fe0fd77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:39.153497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046df8e-8d04-4f9a-b33f-5bd2fe0fd77c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:39.164335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 433/857] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:50:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:39.172988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046df8e-8d04-4f9a-b33f-5bd2fe0fd77c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:39.231737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:39.246113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a983b49-021a-46ce-a17e-b3b97d2c26a3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:39.289865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca16c9-8962-4ee0-b51f-337ab533dd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:39.290872 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca16c9-8962-4ee0-b51f-337ab533dd67 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:39.291156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca16c9-8962-4ee0-b51f-337ab533dd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:39.291432 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca16c9-8962-4ee0-b51f-337ab533dd67 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:39.292690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca16c9-8962-4ee0-b51f-337ab533dd67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:39.294244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca16c9-8962-4ee0-b51f-337ab533dd67 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:39.300496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046df8e-8d04-4f9a-b33f-5bd2fe0fd77c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-aeca16c9-8962-4ee0-b51f-337ab533dd67 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:39.310390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:39.311592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:39.312481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 425/858] 10.222.0.85 () {56 vars in 1132 bytes} [Wed Jul 20 21:50:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:39.317628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:39.319731 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca16c9-8962-4ee0-b51f-337ab533dd67 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:39.344995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250000-afb2-4325-949d-ff8d5b0a88fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:39.346017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250000-afb2-4325-949d-ff8d5b0a88fd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:39.346395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250000-afb2-4325-949d-ff8d5b0a88fd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:39.346770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16250000-afb2-4325-949d-ff8d5b0a88fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:39.358739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250000-afb2-4325-949d-ff8d5b0a88fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:39.360349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16250000-afb2-4325-949d-ff8d5b0a88fd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-16250000-afb2-4325-949d-ff8d5b0a88fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:39.378728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:39.380257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:39.382152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:39.382152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:39.382152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:39.382152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:39.382152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 434/859] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:39.387673 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250000-afb2-4325-949d-ff8d5b0a88fd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:39.448976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca16c9-8962-4ee0-b51f-337ab533dd67 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:39.495129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baad4da-6ad8-4ede-9061-b791d76d4acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:39.499954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad4da-6ad8-4ede-9061-b791d76d4acb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:39.499954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad4da-6ad8-4ede-9061-b791d76d4acb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:39.499954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baad4da-6ad8-4ede-9061-b791d76d4acb None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:39.500394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16250000-afb2-4325-949d-ff8d5b0a88fd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:39.500550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baad4da-6ad8-4ede-9061-b791d76d4acb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:39.500550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baad4da-6ad8-4ede-9061-b791d76d4acb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:39.503968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baad4da-6ad8-4ede-9061-b791d76d4acb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:39.511410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 426/860] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:39.517026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baad4da-6ad8-4ede-9061-b791d76d4acb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:39.541872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a77f-1e55-4f67-8811-0d9822c91a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:39.542640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a77f-1e55-4f67-8811-0d9822c91a62 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:39.543009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a77f-1e55-4f67-8811-0d9822c91a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:39.543382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06a77f-1e55-4f67-8811-0d9822c91a62 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:39.544211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06a77f-1e55-4f67-8811-0d9822c91a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:39.544605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06a77f-1e55-4f67-8811-0d9822c91a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:39.546048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06a77f-1e55-4f67-8811-0d9822c91a62 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:39.552463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:39.565867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 435/861] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:39.567194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a77f-1e55-4f67-8811-0d9822c91a62 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:39.572900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:39.635830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baad4da-6ad8-4ede-9061-b791d76d4acb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:39.679052 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a16d6-1d25-45c1-bcf8-ff64120bbc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:39.679828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a16d6-1d25-45c1-bcf8-ff64120bbc4d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:39.680176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a16d6-1d25-45c1-bcf8-ff64120bbc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:39.680515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a16d6-1d25-45c1-bcf8-ff64120bbc4d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:39.681248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a16d6-1d25-45c1-bcf8-ff64120bbc4d None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:39.682098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a16d6-1d25-45c1-bcf8-ff64120bbc4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:39.683601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a16d6-1d25-45c1-bcf8-ff64120bbc4d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:39.689200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 427/862] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:39.694239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06a77f-1e55-4f67-8811-0d9822c91a62 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:39.736936 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992ade8-3149-4965-bb5b-ea36e9209104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:39.737929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ade8-3149-4965-bb5b-ea36e9209104 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:39.738210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ade8-3149-4965-bb5b-ea36e9209104 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:39.738487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c992ade8-3149-4965-bb5b-ea36e9209104 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:39.748758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992ade8-3149-4965-bb5b-ea36e9209104 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:39.750376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c992ade8-3149-4965-bb5b-ea36e9209104 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c992ade8-3149-4965-bb5b-ea36e9209104 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:39.768754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:39.771013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:39.773339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:39.773339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:39.773339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:39.773339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:39.773339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:39.773339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:39.773339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:39.773339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:39.773339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:39.773339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:39.779948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 436/863] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Jul 20 21:50:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:39.780212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a16d6-1d25-45c1-bcf8-ff64120bbc4d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:39.873357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:39.897059 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a16d6-1d25-45c1-bcf8-ff64120bbc4d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:39.934146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9953a8-c303-42d6-a7b5-63c3975f005d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:39.934815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9953a8-c303-42d6-a7b5-63c3975f005d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:39.935094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9953a8-c303-42d6-a7b5-63c3975f005d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:39.935368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9953a8-c303-42d6-a7b5-63c3975f005d None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:39.936224 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9953a8-c303-42d6-a7b5-63c3975f005d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:39.936530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9953a8-c303-42d6-a7b5-63c3975f005d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:39.937958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9953a8-c303-42d6-a7b5-63c3975f005d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:39.960091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 428/864] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Jul 20 21:50:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:39.967889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992ade8-3149-4965-bb5b-ea36e9209104 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:40.032469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:40.072240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c992ade8-3149-4965-bb5b-ea36e9209104 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:40.112082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b6f4a-4be2-4b6c-b52c-493a52344725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:40.113073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b6f4a-4be2-4b6c-b52c-493a52344725 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:40.113549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b6f4a-4be2-4b6c-b52c-493a52344725 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:40.114029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b6f4a-4be2-4b6c-b52c-493a52344725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:40.187116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b6f4a-4be2-4b6c-b52c-493a52344725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:40.188946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b6f4a-4be2-4b6c-b52c-493a52344725 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:40.254949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:40.294539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0222e-bac4-4668-a74a-d9da969a8571 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:40.294727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0222e-bac4-4668-a74a-d9da969a8571 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:40.294974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce0222e-bac4-4668-a74a-d9da969a8571 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:40.296632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 429/865] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:40.299016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 437/866] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 20 21:50:40.304566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0222e-bac4-4668-a74a-d9da969a8571 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:40.305765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765638-8f43-4a29-9156-9e2330432632 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:40.306220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765638-8f43-4a29-9156-9e2330432632 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:40.306679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a765638-8f43-4a29-9156-9e2330432632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:40.330333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4a765638-8f43-4a29-9156-9e2330432632 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:40.332297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4a765638-8f43-4a29-9156-9e2330432632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:40.415942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 438/867] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:40.433429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce0222e-bac4-4668-a74a-d9da969a8571 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:40.439223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765638-8f43-4a29-9156-9e2330432632 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:40.478800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f665e-1cb6-404f-a1bb-ca2884ac603a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:40.479597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f665e-1cb6-404f-a1bb-ca2884ac603a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:40.479872 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f665e-1cb6-404f-a1bb-ca2884ac603a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:40.480168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f665e-1cb6-404f-a1bb-ca2884ac603a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:40.487211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:40.491580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f665e-1cb6-404f-a1bb-ca2884ac603a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:40.493290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f665e-1cb6-404f-a1bb-ca2884ac603a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-df3f665e-1cb6-404f-a1bb-ca2884ac603a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:40.513657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:40.514601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:40.516114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:40.516114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:40.516114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:40.516114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:40.516114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 430/868] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:40.521041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f665e-1cb6-404f-a1bb-ca2884ac603a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:40.562673 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:40.572601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a765638-8f43-4a29-9156-9e2330432632 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:40.616261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb2e8-c31d-4263-bf09-fe5735d84bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:40.617018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb2e8-c31d-4263-bf09-fe5735d84bb3 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:40.617356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb2e8-c31d-4263-bf09-fe5735d84bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:40.617691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4cb2e8-c31d-4263-bf09-fe5735d84bb3 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:40.618485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cb2e8-c31d-4263-bf09-fe5735d84bb3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:40.620130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4cb2e8-c31d-4263-bf09-fe5735d84bb3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:40.633316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f665e-1cb6-404f-a1bb-ca2884ac603a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:40.670147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475b31e-b73e-4c24-8064-9d5735feb548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:40.670894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475b31e-b73e-4c24-8064-9d5735feb548 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:40.671175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475b31e-b73e-4c24-8064-9d5735feb548 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:40.671448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475b31e-b73e-4c24-8064-9d5735feb548 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:40.672202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475b31e-b73e-4c24-8064-9d5735feb548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:40.676373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475b31e-b73e-4c24-8064-9d5735feb548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:40.676373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8475b31e-b73e-4c24-8064-9d5735feb548 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:40.687005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 431/869] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:40.692056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475b31e-b73e-4c24-8064-9d5735feb548 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:40.727434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 439/870] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:50:40 2022] POST /identity/v3/services => generated 251 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 21:50:40.758625 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:40.819906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475b31e-b73e-4c24-8064-9d5735feb548 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:40.867766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86ea3d-a863-41eb-aaba-9992d22d6998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:40.868608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86ea3d-a863-41eb-aaba-9992d22d6998 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:40.868923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86ea3d-a863-41eb-aaba-9992d22d6998 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:40.869281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86ea3d-a863-41eb-aaba-9992d22d6998 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:40.877361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86ea3d-a863-41eb-aaba-9992d22d6998 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:40.878847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b86ea3d-a863-41eb-aaba-9992d22d6998 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7b86ea3d-a863-41eb-aaba-9992d22d6998 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:40.895556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:40.896538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:40.897437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:40.897437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:40.897437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:40.897437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:40.897437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:40.897437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:40.897437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:40.897437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:40.897437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 432/871] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:40.905618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb2e8-c31d-4263-bf09-fe5735d84bb3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:41.026963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4cb2e8-c31d-4263-bf09-fe5735d84bb3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:41.063193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f807663-7a76-4e76-8d22-0bb714d0389d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:41.064238 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f807663-7a76-4e76-8d22-0bb714d0389d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:41.064743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f807663-7a76-4e76-8d22-0bb714d0389d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:41.065228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f807663-7a76-4e76-8d22-0bb714d0389d None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:41.066290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f807663-7a76-4e76-8d22-0bb714d0389d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:41.066830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f807663-7a76-4e76-8d22-0bb714d0389d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:41.068487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f807663-7a76-4e76-8d22-0bb714d0389d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:41.082916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 440/872] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:41.088510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86ea3d-a863-41eb-aaba-9992d22d6998 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:41.192666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86ea3d-a863-41eb-aaba-9992d22d6998 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:41.201116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:41.226022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217573-b93d-43ab-a1ed-8fd58bd6d895 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:41.226022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217573-b93d-43ab-a1ed-8fd58bd6d895 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:41.226022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2217573-b93d-43ab-a1ed-8fd58bd6d895 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:41.226022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 441/873] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:41.231249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906127-7b8b-43e3-b0d5-f8e8ca0f99f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:41.231903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906127-7b8b-43e3-b0d5-f8e8ca0f99f8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:41.232156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4981bd-ff38-4351-9067-6e708cc247a9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:41.232306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906127-7b8b-43e3-b0d5-f8e8ca0f99f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:41.232440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906127-7b8b-43e3-b0d5-f8e8ca0f99f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:41.232619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4981bd-ff38-4351-9067-6e708cc247a9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:41.232962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4981bd-ff38-4351-9067-6e708cc247a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:41.233270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906127-7b8b-43e3-b0d5-f8e8ca0f99f8 None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=864f16bb01df4ea3866ed68b7f0eb0da) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:41.233577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906127-7b8b-43e3-b0d5-f8e8ca0f99f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:41.235273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906127-7b8b-43e3-b0d5-f8e8ca0f99f8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:41.242594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 433/874] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:41 2022] GET /identity/v3/role_assignments?user.id=864f16bb01df4ea3866ed68b7f0eb0da&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:41.252593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-da4981bd-ff38-4351-9067-6e708cc247a9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:41.253922 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-da4981bd-ff38-4351-9067-6e708cc247a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:41.266565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:41.337055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 442/875] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:41.363455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906127-7b8b-43e3-b0d5-f8e8ca0f99f8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:41.478013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906127-7b8b-43e3-b0d5-f8e8ca0f99f8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:41.517504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead53d-f69d-48fc-9404-f7df5a6180db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:41.518327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead53d-f69d-48fc-9404-f7df5a6180db None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:41.518613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead53d-f69d-48fc-9404-f7df5a6180db None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:41.518889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ead53d-f69d-48fc-9404-f7df5a6180db None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:41.519548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ead53d-f69d-48fc-9404-f7df5a6180db None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:41.521008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ead53d-f69d-48fc-9404-f7df5a6180db None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-31ead53d-f69d-48fc-9404-f7df5a6180db None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:41.536752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:41.537789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:41.538602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 434/876] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:41.544865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4981bd-ff38-4351-9067-6e708cc247a9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:41.648716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4981bd-ff38-4351-9067-6e708cc247a9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:41.684401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c69ca-ff22-46b2-9ab9-6c16b9c5f363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:41.685060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c69ca-ff22-46b2-9ab9-6c16b9c5f363 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:41.685378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c69ca-ff22-46b2-9ab9-6c16b9c5f363 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:41.685651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c69ca-ff22-46b2-9ab9-6c16b9c5f363 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:41.686361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c69ca-ff22-46b2-9ab9-6c16b9c5f363 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:41.686658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c69ca-ff22-46b2-9ab9-6c16b9c5f363 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:41.688038 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c69ca-ff22-46b2-9ab9-6c16b9c5f363 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:41.693165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 443/877] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Jul 20 21:50:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:41.698821 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead53d-f69d-48fc-9404-f7df5a6180db None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:41.735501 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:41.806688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ead53d-f69d-48fc-9404-f7df5a6180db None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:41.844836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b212f-b58d-4aba-8e53-423e58711196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:41.845500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b212f-b58d-4aba-8e53-423e58711196 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:41.845776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b212f-b58d-4aba-8e53-423e58711196 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:41.846056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b212f-b58d-4aba-8e53-423e58711196 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:41.846774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b212f-b58d-4aba-8e53-423e58711196 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:41.847084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b212f-b58d-4aba-8e53-423e58711196 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:41.848511 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b212f-b58d-4aba-8e53-423e58711196 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:41.854451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 435/878] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Jul 20 21:50:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:41.904834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a5da5-7d74-4620-8a7e-a03ae9a95165 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:41.905013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a5da5-7d74-4620-8a7e-a03ae9a95165 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:41.905301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a5da5-7d74-4620-8a7e-a03ae9a95165 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:41.907018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 444/879] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:41.912923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53349841-9039-4d84-a7bc-8615b56ee9fb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:41.913259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53349841-9039-4d84-a7bc-8615b56ee9fb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:41.913492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53349841-9039-4d84-a7bc-8615b56ee9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:41.933427 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-53349841-9039-4d84-a7bc-8615b56ee9fb None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:41.934678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-53349841-9039-4d84-a7bc-8615b56ee9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:42.014695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 436/880] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:42.041346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a5da5-7d74-4620-8a7e-a03ae9a95165 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:42.054227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:42.155438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a5da5-7d74-4620-8a7e-a03ae9a95165 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:42.192124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781b519-74b6-4bb3-9746-3672e2e04260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:42.193049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781b519-74b6-4bb3-9746-3672e2e04260 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:42.193483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781b519-74b6-4bb3-9746-3672e2e04260 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:42.193913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781b519-74b6-4bb3-9746-3672e2e04260 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:42.194849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781b519-74b6-4bb3-9746-3672e2e04260 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:42.196438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781b519-74b6-4bb3-9746-3672e2e04260 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:42.353342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 445/881] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:50:42 2022] POST /identity/v3/services => generated 269 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:42.956978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa634e2-36b0-49b0-947b-5c70403d8862 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:42.957765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa634e2-36b0-49b0-947b-5c70403d8862 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:42.958217 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa634e2-36b0-49b0-947b-5c70403d8862 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:42.960183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 437/882] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:42.966034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97c6a6-ff2e-4c71-b864-3ea69bde844b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:42.966621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97c6a6-ff2e-4c71-b864-3ea69bde844b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:42.967120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97c6a6-ff2e-4c71-b864-3ea69bde844b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:42.985458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9f97c6a6-ff2e-4c71-b864-3ea69bde844b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:42.986968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9f97c6a6-ff2e-4c71-b864-3ea69bde844b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:43.053737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:43.066365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 446/883] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:43.089719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa634e2-36b0-49b0-947b-5c70403d8862 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:43.125746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:43.203012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa634e2-36b0-49b0-947b-5c70403d8862 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:43.238240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b374ed-c441-4a82-ad44-65e27cefbf27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:43.239032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b374ed-c441-4a82-ad44-65e27cefbf27 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:43.239369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b374ed-c441-4a82-ad44-65e27cefbf27 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:43.239645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b374ed-c441-4a82-ad44-65e27cefbf27 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:43.240367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b374ed-c441-4a82-ad44-65e27cefbf27 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:43.241740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b374ed-c441-4a82-ad44-65e27cefbf27 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b0b374ed-c441-4a82-ad44-65e27cefbf27 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:43.254420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:43.255392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:43.256235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 438/884] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:50:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:43.261555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97c6a6-ff2e-4c71-b864-3ea69bde844b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:43.373046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97c6a6-ff2e-4c71-b864-3ea69bde844b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:43.408098 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c22a9-0917-4e59-9423-e6e022447ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:43.408764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c22a9-0917-4e59-9423-e6e022447ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:43.409044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c22a9-0917-4e59-9423-e6e022447ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:43.409315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c22a9-0917-4e59-9423-e6e022447ef1 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:43.410026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c22a9-0917-4e59-9423-e6e022447ef1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:43.410329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c22a9-0917-4e59-9423-e6e022447ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:43.411696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c22a9-0917-4e59-9423-e6e022447ef1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:43.417714 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 447/885] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:50:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:43.423184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b374ed-c441-4a82-ad44-65e27cefbf27 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:43.444764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b34e8-f506-49d3-81c1-970676773d0d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:43.445268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b34e8-f506-49d3-81c1-970676773d0d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:43.445678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b34e8-f506-49d3-81c1-970676773d0d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:43.447457 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 448/886] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:43.452497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87664b8f-d968-43c2-892d-93bdbf358190 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:43.452988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87664b8f-d968-43c2-892d-93bdbf358190 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:43.453469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87664b8f-d968-43c2-892d-93bdbf358190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:43.471985 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-87664b8f-d968-43c2-892d-93bdbf358190 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:43.473468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-87664b8f-d968-43c2-892d-93bdbf358190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:43.540200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:43.549168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:43.550614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b374ed-c441-4a82-ad44-65e27cefbf27 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:43.570745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 449/887] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:43.593549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87664b8f-d968-43c2-892d-93bdbf358190 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:43.593776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f4a45-f760-448b-a0a4-a8909e587825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:43.594386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f4a45-f760-448b-a0a4-a8909e587825 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:43.594717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f4a45-f760-448b-a0a4-a8909e587825 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:43.594998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f4a45-f760-448b-a0a4-a8909e587825 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:43.595776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f4a45-f760-448b-a0a4-a8909e587825 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:43.596124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f4a45-f760-448b-a0a4-a8909e587825 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:43.598607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f4a45-f760-448b-a0a4-a8909e587825 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:43.605414 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 439/888] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:50:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:43.610831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f4a45-f760-448b-a0a4-a8909e587825 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:43.716360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f4a45-f760-448b-a0a4-a8909e587825 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:43.729928 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87664b8f-d968-43c2-892d-93bdbf358190 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:43.752621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc6779-eda8-47ef-bbdc-f11007df91a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:43.753712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc6779-eda8-47ef-bbdc-f11007df91a6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:43.754160 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc6779-eda8-47ef-bbdc-f11007df91a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:43.754733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc6779-eda8-47ef-bbdc-f11007df91a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:43.755888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc6779-eda8-47ef-bbdc-f11007df91a6 None admin] RBAC: Adding query filter params (interface=public, service_id=e9eb1cd34e61431ea47dc30a26d734dc, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:43.756459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc6779-eda8-47ef-bbdc-f11007df91a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:43.758099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccc6779-eda8-47ef-bbdc-f11007df91a6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:43.769454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 440/889] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Jul 20 21:50:43 2022] GET /identity/v3/endpoints?service_id=e9eb1cd34e61431ea47dc30a26d734dc&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:43.770518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc6779-eda8-47ef-bbdc-f11007df91a6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:43.772682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeb465-d784-4158-8c01-3e17284ab0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:43.773493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeb465-d784-4158-8c01-3e17284ab0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:43.773771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeb465-d784-4158-8c01-3e17284ab0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:43.774043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdeb465-d784-4158-8c01-3e17284ab0a8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:43.789044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdeb465-d784-4158-8c01-3e17284ab0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-ebdeb465-d784-4158-8c01-3e17284ab0a8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:43.799657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:43.800646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:50:43.801523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:43.802179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:43.803989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 450/890] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Jul 20 21:50:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:43.807100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeb465-d784-4158-8c01-3e17284ab0a8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:43.870044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:43.888996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccc6779-eda8-47ef-bbdc-f11007df91a6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:43.931875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44354bdf-a01f-49c8-9746-8030864ddcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:43.932971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44354bdf-a01f-49c8-9746-8030864ddcbb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:43.933548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44354bdf-a01f-49c8-9746-8030864ddcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:43.934210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44354bdf-a01f-49c8-9746-8030864ddcbb None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:43.935259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44354bdf-a01f-49c8-9746-8030864ddcbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:43.936885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44354bdf-a01f-49c8-9746-8030864ddcbb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:43.937734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdeb465-d784-4158-8c01-3e17284ab0a8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:43.948524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 441/891] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Jul 20 21:50:43 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 21:50:43.981658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ae70e-817a-418a-8bc8-3ed94bdf1444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:43.982615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ae70e-817a-418a-8bc8-3ed94bdf1444 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:43.983040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ae70e-817a-418a-8bc8-3ed94bdf1444 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:43.983473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ae70e-817a-418a-8bc8-3ed94bdf1444 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:43.984466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ae70e-817a-418a-8bc8-3ed94bdf1444 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:43.984938 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ae70e-817a-418a-8bc8-3ed94bdf1444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:43.986463 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804ae70e-817a-418a-8bc8-3ed94bdf1444 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:43.996690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 451/892] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Jul 20 21:50:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:44.004687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44354bdf-a01f-49c8-9746-8030864ddcbb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:44.104590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:44.119601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68df6-f6fc-4d22-9129-486daa9959f9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:44.122617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68df6-f6fc-4d22-9129-486daa9959f9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:44.122617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d68df6-f6fc-4d22-9129-486daa9959f9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:44.122617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 452/893] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:44.125698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44354bdf-a01f-49c8-9746-8030864ddcbb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:44.128942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b20ff-2db5-4f82-ad4e-360c63048178 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:44.129535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b20ff-2db5-4f82-ad4e-360c63048178 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:44.130183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b20ff-2db5-4f82-ad4e-360c63048178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:44.155061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c45b20ff-2db5-4f82-ad4e-360c63048178 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:44.156849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c45b20ff-2db5-4f82-ad4e-360c63048178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:44.184485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac487a1b-19c5-4551-8ef6-1c3f17ea25b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:44.185341 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487a1b-19c5-4551-8ef6-1c3f17ea25b1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:44.185627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487a1b-19c5-4551-8ef6-1c3f17ea25b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:44.185904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac487a1b-19c5-4551-8ef6-1c3f17ea25b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:44.199185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac487a1b-19c5-4551-8ef6-1c3f17ea25b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:44.201297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac487a1b-19c5-4551-8ef6-1c3f17ea25b1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ac487a1b-19c5-4551-8ef6-1c3f17ea25b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:44.220355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:44.221355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:44.222299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:44.222299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:44.222299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:44.222299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:44.222299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 442/894] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:44.230211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac487a1b-19c5-4551-8ef6-1c3f17ea25b1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:44.253237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 453/895] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:44.276659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b20ff-2db5-4f82-ad4e-360c63048178 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:44.328228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:44.354436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac487a1b-19c5-4551-8ef6-1c3f17ea25b1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:44.402597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33897fbd-5c00-4c7d-8738-be1aeea64254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:44.403276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33897fbd-5c00-4c7d-8738-be1aeea64254 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:44.403557 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33897fbd-5c00-4c7d-8738-be1aeea64254 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:44.403831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33897fbd-5c00-4c7d-8738-be1aeea64254 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:44.404582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33897fbd-5c00-4c7d-8738-be1aeea64254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:44.404885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33897fbd-5c00-4c7d-8738-be1aeea64254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:44.405873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b20ff-2db5-4f82-ad4e-360c63048178 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:44.406267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33897fbd-5c00-4c7d-8738-be1aeea64254 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:44.410169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:44.427955 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 443/896] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:44.431367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33897fbd-5c00-4c7d-8738-be1aeea64254 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:44.452203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb13404-896c-4e9d-a21b-6e4092767e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:44.453214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13404-896c-4e9d-a21b-6e4092767e4f None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:44.453609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13404-896c-4e9d-a21b-6e4092767e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:44.453982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb13404-896c-4e9d-a21b-6e4092767e4f None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:44.454827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb13404-896c-4e9d-a21b-6e4092767e4f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:44.456854 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb13404-896c-4e9d-a21b-6e4092767e4f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:44.536636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 454/897] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:50:44 2022] POST /identity/v3/services => generated 241 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 21:50:44.537960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b904ec1-4b50-493a-abe5-40fe5f347ab9 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:44.538250 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b904ec1-4b50-493a-abe5-40fe5f347ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:44.538529 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b904ec1-4b50-493a-abe5-40fe5f347ab9 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:44.544089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 455/898] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:44.545883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf030a-0268-4864-956f-d33fa40eeaba None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:44.546315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf030a-0268-4864-956f-d33fa40eeaba None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:44.546730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf030a-0268-4864-956f-d33fa40eeaba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:44.553771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33897fbd-5c00-4c7d-8738-be1aeea64254 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:44.566416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5bdf030a-0268-4864-956f-d33fa40eeaba None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:44.568136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5bdf030a-0268-4864-956f-d33fa40eeaba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:44.604057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4007efa-ef82-43a3-954d-023a483e0809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:44.604890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4007efa-ef82-43a3-954d-023a483e0809 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:44.605172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4007efa-ef82-43a3-954d-023a483e0809 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:44.605451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4007efa-ef82-43a3-954d-023a483e0809 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:44.618461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4007efa-ef82-43a3-954d-023a483e0809 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:44.620856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4007efa-ef82-43a3-954d-023a483e0809 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f4007efa-ef82-43a3-954d-023a483e0809 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:44.643359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:44.644409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:44.645363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:44.645363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:44.645363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:44.645363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:44.645363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:44.645363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:44.645363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:44.645363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:44.645363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:44.645363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:44.645897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 444/899] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Jul 20 21:50:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:44.653308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4007efa-ef82-43a3-954d-023a483e0809 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:44.676099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 456/900] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:44.696445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf030a-0268-4864-956f-d33fa40eeaba None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:44.721513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:44.733290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:44.808722 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4007efa-ef82-43a3-954d-023a483e0809 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:44.834660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf030a-0268-4864-956f-d33fa40eeaba None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:44.854229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93014ff-411e-4f4a-857f-71281375d1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:44.855189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93014ff-411e-4f4a-857f-71281375d1d5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:44.855481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93014ff-411e-4f4a-857f-71281375d1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:44.855758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93014ff-411e-4f4a-857f-71281375d1d5 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:44.856644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93014ff-411e-4f4a-857f-71281375d1d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:44.857100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93014ff-411e-4f4a-857f-71281375d1d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:44.858884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93014ff-411e-4f4a-857f-71281375d1d5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:44.879098 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c377f-8d18-4ce7-a558-ac0799e65dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:44.880549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c377f-8d18-4ce7-a558-ac0799e65dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:44.880985 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c377f-8d18-4ce7-a558-ac0799e65dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:44.881424 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24c377f-8d18-4ce7-a558-ac0799e65dd3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:44.882007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 445/901] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Jul 20 21:50:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:44.882458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c377f-8d18-4ce7-a558-ac0799e65dd3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:44.884149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24c377f-8d18-4ce7-a558-ac0799e65dd3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:44.891338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93014ff-411e-4f4a-857f-71281375d1d5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c24c377f-8d18-4ce7-a558-ac0799e65dd3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:44.905929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:44.907030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 21:50:44.907879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:44.911110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 457/902] 10.222.0.85 () {56 vars in 1132 bytes} [Wed Jul 20 21:50:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:44.919953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c377f-8d18-4ce7-a558-ac0799e65dd3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:45.040715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93014ff-411e-4f4a-857f-71281375d1d5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:45.053362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:45.073265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:45.080975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24c377f-8d18-4ce7-a558-ac0799e65dd3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:45.085858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3501cf-7ced-4ec3-a6bb-1b12f515144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:45.086621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3501cf-7ced-4ec3-a6bb-1b12f515144c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:45.086901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3501cf-7ced-4ec3-a6bb-1b12f515144c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:45.087173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3501cf-7ced-4ec3-a6bb-1b12f515144c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:45.132587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ed742-eb48-4d7a-93ef-fe9c7b56625e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:45.134987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ed742-eb48-4d7a-93ef-fe9c7b56625e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:45.135480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ed742-eb48-4d7a-93ef-fe9c7b56625e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:45.135987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8ed742-eb48-4d7a-93ef-fe9c7b56625e None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:45.136930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ed742-eb48-4d7a-93ef-fe9c7b56625e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:45.137455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ed742-eb48-4d7a-93ef-fe9c7b56625e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:45.139030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8ed742-eb48-4d7a-93ef-fe9c7b56625e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:45.145856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 458/903] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:45.153440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ed742-eb48-4d7a-93ef-fe9c7b56625e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:45.176486 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3501cf-7ced-4ec3-a6bb-1b12f515144c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:45.179048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3501cf-7ced-4ec3-a6bb-1b12f515144c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:45.275005 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8ed742-eb48-4d7a-93ef-fe9c7b56625e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:45.295519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 446/904] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:44 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:50:45.297113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3501cf-7ced-4ec3-a6bb-1b12f515144c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:45.310689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:45.327304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068d861-5962-4601-b8ba-c25a08e5b8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:45.327304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068d861-5962-4601-b8ba-c25a08e5b8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:45.327304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068d861-5962-4601-b8ba-c25a08e5b8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:45.327304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068d861-5962-4601-b8ba-c25a08e5b8a3 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:45.327694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068d861-5962-4601-b8ba-c25a08e5b8a3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:45.328473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068d861-5962-4601-b8ba-c25a08e5b8a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:45.330493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068d861-5962-4601-b8ba-c25a08e5b8a3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:45.344855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 459/905] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:45.346068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068d861-5962-4601-b8ba-c25a08e5b8a3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:45.382459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:45.420013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3501cf-7ced-4ec3-a6bb-1b12f515144c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:45.469222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03e011-8dc0-45d1-b26d-42165991eee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:45.470179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03e011-8dc0-45d1-b26d-42165991eee4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:45.470558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03e011-8dc0-45d1-b26d-42165991eee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:45.470932 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d03e011-8dc0-45d1-b26d-42165991eee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:45.482561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03e011-8dc0-45d1-b26d-42165991eee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:45.484165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d03e011-8dc0-45d1-b26d-42165991eee4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:45.502459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068d861-5962-4601-b8ba-c25a08e5b8a3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0d03e011-8dc0-45d1-b26d-42165991eee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:45.502859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:45.503907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:45.505013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:45.505013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:45.505013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:45.505013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:45.510955 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 447/906] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:45.511742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03e011-8dc0-45d1-b26d-42165991eee4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:45.549002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b14d1d-94eb-48aa-bacc-8654da1d56f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:45.549666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b14d1d-94eb-48aa-bacc-8654da1d56f1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:45.549995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b14d1d-94eb-48aa-bacc-8654da1d56f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:45.550276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b14d1d-94eb-48aa-bacc-8654da1d56f1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:45.551191 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b14d1d-94eb-48aa-bacc-8654da1d56f1 None admin] RBAC: Adding query filter params (interface=public, service_id=3cf4b9fceecb45aeb75eac4220fe5dba, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:45.551373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b14d1d-94eb-48aa-bacc-8654da1d56f1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:45.552753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b14d1d-94eb-48aa-bacc-8654da1d56f1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:45.562674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 460/907] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Jul 20 21:50:45 2022] GET /identity/v3/endpoints?service_id=3cf4b9fceecb45aeb75eac4220fe5dba&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:45.563676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b14d1d-94eb-48aa-bacc-8654da1d56f1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:45.596481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:45.641980 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d03e011-8dc0-45d1-b26d-42165991eee4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:45.679100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca19d-8da3-4d2d-897e-0dd755ad2975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:45.679767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca19d-8da3-4d2d-897e-0dd755ad2975 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:45.680105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca19d-8da3-4d2d-897e-0dd755ad2975 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:45.680382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ca19d-8da3-4d2d-897e-0dd755ad2975 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:45.681138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ca19d-8da3-4d2d-897e-0dd755ad2975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:45.681468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ca19d-8da3-4d2d-897e-0dd755ad2975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:45.682832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04ca19d-8da3-4d2d-897e-0dd755ad2975 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:45.690102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:45.699783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 448/908] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:45.700887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca19d-8da3-4d2d-897e-0dd755ad2975 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:45.713925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b14d1d-94eb-48aa-bacc-8654da1d56f1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:45.757772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f0de2-af98-40de-901f-ccc1e7dc656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:45.758820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f0de2-af98-40de-901f-ccc1e7dc656f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:45.759299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f0de2-af98-40de-901f-ccc1e7dc656f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:45.759721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f0de2-af98-40de-901f-ccc1e7dc656f None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:45.761040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f0de2-af98-40de-901f-ccc1e7dc656f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:45.762872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f0de2-af98-40de-901f-ccc1e7dc656f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:45.771891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 461/909] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Jul 20 21:50:45 2022] GET /identity/v3/services => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 21:50:45.817908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ca19d-8da3-4d2d-897e-0dd755ad2975 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:45.845522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:45.858192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bef6c8-d84d-4b8b-a8d0-4dea0bc2d0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:45.859266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bef6c8-d84d-4b8b-a8d0-4dea0bc2d0e5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:45.859717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bef6c8-d84d-4b8b-a8d0-4dea0bc2d0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:45.860220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bef6c8-d84d-4b8b-a8d0-4dea0bc2d0e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:45.868647 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bef6c8-d84d-4b8b-a8d0-4dea0bc2d0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:45.870379 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bef6c8-d84d-4b8b-a8d0-4dea0bc2d0e5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-53bef6c8-d84d-4b8b-a8d0-4dea0bc2d0e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:45.887164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:45.888322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:45.889409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:45.889409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:45.889409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:45.889409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:45.889409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:45.889409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:45.889409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:45.889409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:45.891854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 449/910] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:45.897827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f0de2-af98-40de-901f-ccc1e7dc656f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:46.019082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f0de2-af98-40de-901f-ccc1e7dc656f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:46.055569 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8750460c-c25d-4285-b043-3d55e5af6b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:46.057168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750460c-c25d-4285-b043-3d55e5af6b6f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:46.057757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750460c-c25d-4285-b043-3d55e5af6b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:46.058173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8750460c-c25d-4285-b043-3d55e5af6b6f None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:46.059099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750460c-c25d-4285-b043-3d55e5af6b6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:46.059548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750460c-c25d-4285-b043-3d55e5af6b6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:46.061136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8750460c-c25d-4285-b043-3d55e5af6b6f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:46.074286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 462/911] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:46.080432 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bef6c8-d84d-4b8b-a8d0-4dea0bc2d0e5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:46.185912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bef6c8-d84d-4b8b-a8d0-4dea0bc2d0e5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:46.222203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80640123-0c7f-4f12-ae01-70443aafaa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:46.223182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640123-0c7f-4f12-ae01-70443aafaa54 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:46.223623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640123-0c7f-4f12-ae01-70443aafaa54 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:46.224084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80640123-0c7f-4f12-ae01-70443aafaa54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:46.225053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80640123-0c7f-4f12-ae01-70443aafaa54 None admin] RBAC: Adding query filter params (role.id=261be7f206d549628e13bb85aeae222a, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=864f16bb01df4ea3866ed68b7f0eb0da) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:46.225507 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80640123-0c7f-4f12-ae01-70443aafaa54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:46.227090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80640123-0c7f-4f12-ae01-70443aafaa54 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:46.234649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 450/912] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:46 2022] GET /identity/v3/role_assignments?user.id=864f16bb01df4ea3866ed68b7f0eb0da&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=261be7f206d549628e13bb85aeae222a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:46.264618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8032de-4d64-43ed-aa2b-b52594263b41 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:46.265141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8032de-4d64-43ed-aa2b-b52594263b41 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:46.265235 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8032de-4d64-43ed-aa2b-b52594263b41 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:46.267169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 463/913] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:46.272937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7a2cf-87c5-4ef7-8c0a-f4acfde60edf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:46.273495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7a2cf-87c5-4ef7-8c0a-f4acfde60edf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:46.273918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7a2cf-87c5-4ef7-8c0a-f4acfde60edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:46.293521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fbf7a2cf-87c5-4ef7-8c0a-f4acfde60edf None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:46.295010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fbf7a2cf-87c5-4ef7-8c0a-f4acfde60edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:46.347822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:46.373722 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 451/914] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:46.396869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8032de-4d64-43ed-aa2b-b52594263b41 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:46.413016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:46.516056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8032de-4d64-43ed-aa2b-b52594263b41 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:46.553208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a36562-1623-4905-8215-80917456e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:46.554015 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36562-1623-4905-8215-80917456e857 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:46.554314 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36562-1623-4905-8215-80917456e857 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:46.554572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a36562-1623-4905-8215-80917456e857 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:46.555282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a36562-1623-4905-8215-80917456e857 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:46.556765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a36562-1623-4905-8215-80917456e857 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c1a36562-1623-4905-8215-80917456e857 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:46.569867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:46.570937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:46.571856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 464/915] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:50:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:46.577489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7a2cf-87c5-4ef7-8c0a-f4acfde60edf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:46.697736 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7a2cf-87c5-4ef7-8c0a-f4acfde60edf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:46.745772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0263c-8e94-40b9-8ad8-b7761cf06fcf None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:46.746157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0263c-8e94-40b9-8ad8-b7761cf06fcf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:46.746539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c0263c-8e94-40b9-8ad8-b7761cf06fcf None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:46.748360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028cbd-8c5b-4577-9470-f720c97c5818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:46.748635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 465/916] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:46.749027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028cbd-8c5b-4577-9470-f720c97c5818 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:46.749304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028cbd-8c5b-4577-9470-f720c97c5818 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:46.749578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4028cbd-8c5b-4577-9470-f720c97c5818 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:46.750292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4028cbd-8c5b-4577-9470-f720c97c5818 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:46.750594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4028cbd-8c5b-4577-9470-f720c97c5818 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:46.751990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4028cbd-8c5b-4577-9470-f720c97c5818 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:46.757969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 452/917] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:50:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:46.758141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e906bc3-0af5-4b9f-8cf5-2a1eaf586575 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:46.758396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e906bc3-0af5-4b9f-8cf5-2a1eaf586575 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:46.758746 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e906bc3-0af5-4b9f-8cf5-2a1eaf586575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:46.766247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028cbd-8c5b-4577-9470-f720c97c5818 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:46.779819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0e906bc3-0af5-4b9f-8cf5-2a1eaf586575 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:46.781180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0e906bc3-0af5-4b9f-8cf5-2a1eaf586575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:46.814486 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:46.861614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 466/918] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:46.888959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e906bc3-0af5-4b9f-8cf5-2a1eaf586575 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:46.893705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:46.897341 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4028cbd-8c5b-4577-9470-f720c97c5818 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:46.935476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01156069-7117-423d-8f75-16a7be1b0a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:46.936177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156069-7117-423d-8f75-16a7be1b0a05 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:46.936460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156069-7117-423d-8f75-16a7be1b0a05 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:46.936736 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156069-7117-423d-8f75-16a7be1b0a05 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:46.937451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01156069-7117-423d-8f75-16a7be1b0a05 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:46.937758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01156069-7117-423d-8f75-16a7be1b0a05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:46.939268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01156069-7117-423d-8f75-16a7be1b0a05 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:46.954896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 453/919] 10.222.0.85 () {56 vars in 1114 bytes} [Wed Jul 20 21:50:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:46.956333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01156069-7117-423d-8f75-16a7be1b0a05 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:47.051597 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e906bc3-0af5-4b9f-8cf5-2a1eaf586575 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:47.106531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d6cb5-a0b5-4cf3-a746-63998407f2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:47.107194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01156069-7117-423d-8f75-16a7be1b0a05 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:47.107647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d6cb5-a0b5-4cf3-a746-63998407f2fa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:47.107647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d6cb5-a0b5-4cf3-a746-63998407f2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:47.108014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d6cb5-a0b5-4cf3-a746-63998407f2fa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:47.108570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d6cb5-a0b5-4cf3-a746-63998407f2fa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:47.110232 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d6cb5-a0b5-4cf3-a746-63998407f2fa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:47.112219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-347d6cb5-a0b5-4cf3-a746-63998407f2fa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:47.128778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:47.129822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:47.130656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:47.134716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 467/920] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:47.141421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d6cb5-a0b5-4cf3-a746-63998407f2fa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:47.150920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbfbfe-a145-4795-81be-e83d8734b168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:47.152496 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbfbfe-a145-4795-81be-e83d8734b168 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:47.153010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbfbfe-a145-4795-81be-e83d8734b168 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:47.153526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fbfbfe-a145-4795-81be-e83d8734b168 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:47.154776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbfbfe-a145-4795-81be-e83d8734b168 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:47.156952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fbfbfe-a145-4795-81be-e83d8734b168 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:47.211205 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:47.245349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d6cb5-a0b5-4cf3-a746-63998407f2fa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:47.280458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 454/921] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Jul 20 21:50:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:47.293767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af962-4723-4dd6-b9b2-441d3ac89deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:47.294542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af962-4723-4dd6-b9b2-441d3ac89deb None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:47.295208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af962-4723-4dd6-b9b2-441d3ac89deb None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:47.296204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61af962-4723-4dd6-b9b2-441d3ac89deb None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:47.297042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af962-4723-4dd6-b9b2-441d3ac89deb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:47.297360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af962-4723-4dd6-b9b2-441d3ac89deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:47.298891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61af962-4723-4dd6-b9b2-441d3ac89deb None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:47.305406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 468/922] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Jul 20 21:50:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:47.311631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbfbfe-a145-4795-81be-e83d8734b168 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:47.431553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fbfbfe-a145-4795-81be-e83d8734b168 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:47.472495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be687fc9-16ff-46b2-a473-290c669db6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:47.473660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be687fc9-16ff-46b2-a473-290c669db6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:47.474173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be687fc9-16ff-46b2-a473-290c669db6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:47.474451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be687fc9-16ff-46b2-a473-290c669db6d6 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:47.475187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be687fc9-16ff-46b2-a473-290c669db6d6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:47.475496 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be687fc9-16ff-46b2-a473-290c669db6d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:47.476973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be687fc9-16ff-46b2-a473-290c669db6d6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:47.483072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 455/923] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Jul 20 21:50:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:47.488988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af962-4723-4dd6-b9b2-441d3ac89deb None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:47.602857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61af962-4723-4dd6-b9b2-441d3ac89deb None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:47.632266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:47.641371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ab617-a162-4d26-9213-f869f73bbbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:47.642034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab617-a162-4d26-9213-f869f73bbbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:47.642339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab617-a162-4d26-9213-f869f73bbbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:47.642637 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ab617-a162-4d26-9213-f869f73bbbd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:47.645059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab617-a162-4d26-9213-f869f73bbbd4 None admin] RBAC: Adding query filter params (interface=public, service_id=b67c804a83f14bb2b3113abe9a78c1e9, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:47.645059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab617-a162-4d26-9213-f869f73bbbd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:47.645221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ab617-a162-4d26-9213-f869f73bbbd4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:47.651404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 469/924] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Jul 20 21:50:47 2022] GET /identity/v3/endpoints?service_id=b67c804a83f14bb2b3113abe9a78c1e9&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:47.657040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be687fc9-16ff-46b2-a473-290c669db6d6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:47.685519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:47.769584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be687fc9-16ff-46b2-a473-290c669db6d6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:47.810689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fba71-24ec-457f-aa72-56ef89b3c741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:47.811351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fba71-24ec-457f-aa72-56ef89b3c741 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:47.811631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fba71-24ec-457f-aa72-56ef89b3c741 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:47.811902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fba71-24ec-457f-aa72-56ef89b3c741 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:47.812604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fba71-24ec-457f-aa72-56ef89b3c741 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:47.813966 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fba71-24ec-457f-aa72-56ef89b3c741 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:47.821000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 456/925] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Jul 20 21:50:47 2022] GET /identity/v3/services => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 21:50:48.006237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7177a-1b63-4687-8322-40a95d71ff6c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:48.006554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7177a-1b63-4687-8322-40a95d71ff6c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:48.006799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7177a-1b63-4687-8322-40a95d71ff6c None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:48.008454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 470/926] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:48.014196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a0231-3b4f-487c-a044-5acaf8fcb346 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:48.014488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a0231-3b4f-487c-a044-5acaf8fcb346 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:48.014768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a0231-3b4f-487c-a044-5acaf8fcb346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:48.031970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-de4a0231-3b4f-487c-a044-5acaf8fcb346 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:48.033176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-de4a0231-3b4f-487c-a044-5acaf8fcb346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:48.105594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 457/927] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:48.128709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7177a-1b63-4687-8322-40a95d71ff6c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:48.240203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7177a-1b63-4687-8322-40a95d71ff6c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:48.275292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38663-aed4-42a8-b17b-c9fba16353fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:48.276140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38663-aed4-42a8-b17b-c9fba16353fd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:48.276419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38663-aed4-42a8-b17b-c9fba16353fd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:48.276688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e38663-aed4-42a8-b17b-c9fba16353fd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:48.277343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e38663-aed4-42a8-b17b-c9fba16353fd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:48.278695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e38663-aed4-42a8-b17b-c9fba16353fd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-43e38663-aed4-42a8-b17b-c9fba16353fd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:48.291986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:48.292971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:48.293842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 471/928] 10.222.0.85 () {56 vars in 1132 bytes} [Wed Jul 20 21:50:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:48.299422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a0231-3b4f-487c-a044-5acaf8fcb346 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:48.318774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:48.408597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a0231-3b4f-487c-a044-5acaf8fcb346 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:48.445577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99d14b-8652-47a0-ad0d-bb8ecaabbaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:48.446658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d14b-8652-47a0-ad0d-bb8ecaabbaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:48.447170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d14b-8652-47a0-ad0d-bb8ecaabbaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:48.447669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99d14b-8652-47a0-ad0d-bb8ecaabbaa6 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:48.448627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99d14b-8652-47a0-ad0d-bb8ecaabbaa6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:48.449138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99d14b-8652-47a0-ad0d-bb8ecaabbaa6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:48.450715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99d14b-8652-47a0-ad0d-bb8ecaabbaa6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:48.456281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 458/929] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:48.467382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38663-aed4-42a8-b17b-c9fba16353fd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:48.469200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b235f-46a0-4e88-be9d-6b4b5d7d80b3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:48.469484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b235f-46a0-4e88-be9d-6b4b5d7d80b3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:48.469758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b235f-46a0-4e88-be9d-6b4b5d7d80b3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:48.471331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 459/930] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:48.476336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b7f74-89f9-4a83-ab41-22df3381f7f6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:48.476668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b7f74-89f9-4a83-ab41-22df3381f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:48.476947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464b7f74-89f9-4a83-ab41-22df3381f7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:48.494635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-464b7f74-89f9-4a83-ab41-22df3381f7f6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:48.495764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-464b7f74-89f9-4a83-ab41-22df3381f7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:48.540354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:48.585532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e38663-aed4-42a8-b17b-c9fba16353fd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:48.585953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 460/931] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:48.611711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b7f74-89f9-4a83-ab41-22df3381f7f6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:48.626303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:48.633810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa22a3-7a3f-461d-b72a-f9ff249f6896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:48.635470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa22a3-7a3f-461d-b72a-f9ff249f6896 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:48.635759 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa22a3-7a3f-461d-b72a-f9ff249f6896 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:48.636218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfa22a3-7a3f-461d-b72a-f9ff249f6896 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:48.637059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa22a3-7a3f-461d-b72a-f9ff249f6896 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:48.637374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa22a3-7a3f-461d-b72a-f9ff249f6896 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:48.639511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfa22a3-7a3f-461d-b72a-f9ff249f6896 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:48.645877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 472/932] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:48.652216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa22a3-7a3f-461d-b72a-f9ff249f6896 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:48.741603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464b7f74-89f9-4a83-ab41-22df3381f7f6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:48.759931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfa22a3-7a3f-461d-b72a-f9ff249f6896 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:48.782338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:48.786053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61967905-c73f-41bb-8813-1f959714c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:48.787108 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61967905-c73f-41bb-8813-1f959714c4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:48.787470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61967905-c73f-41bb-8813-1f959714c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:48.788168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61967905-c73f-41bb-8813-1f959714c4e6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:48.800037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ebbde-529f-43ae-b2b4-0401915f4082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:48.800874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ebbde-529f-43ae-b2b4-0401915f4082 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:48.801330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ebbde-529f-43ae-b2b4-0401915f4082 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:48.801776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61967905-c73f-41bb-8813-1f959714c4e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:48.801882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670ebbde-529f-43ae-b2b4-0401915f4082 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:48.802807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ebbde-529f-43ae-b2b4-0401915f4082 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:48.804412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670ebbde-529f-43ae-b2b4-0401915f4082 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-61967905-c73f-41bb-8813-1f959714c4e6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:48.811418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:48.812534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:50:48.813359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:48.816070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 461/933] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Jul 20 21:50:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:48.819475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61967905-c73f-41bb-8813-1f959714c4e6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:48.896443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:48.928001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 473/934] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Jul 20 21:50:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:48.933742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61967905-c73f-41bb-8813-1f959714c4e6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:48.982683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36831314-86f3-4ccc-a8a5-c9c19c4062a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:48.983367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36831314-86f3-4ccc-a8a5-c9c19c4062a0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:48.983679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36831314-86f3-4ccc-a8a5-c9c19c4062a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:48.983986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36831314-86f3-4ccc-a8a5-c9c19c4062a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:48.984797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36831314-86f3-4ccc-a8a5-c9c19c4062a0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:48.985104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36831314-86f3-4ccc-a8a5-c9c19c4062a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:48.986799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36831314-86f3-4ccc-a8a5-c9c19c4062a0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:48.997352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 462/935] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Jul 20 21:50:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:49.003064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ebbde-529f-43ae-b2b4-0401915f4082 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:49.136652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670ebbde-529f-43ae-b2b4-0401915f4082 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:49.172958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d234d8-5e16-48e0-b33f-9b42b54936c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:49.173756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d234d8-5e16-48e0-b33f-9b42b54936c4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:49.174033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d234d8-5e16-48e0-b33f-9b42b54936c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:49.174303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d234d8-5e16-48e0-b33f-9b42b54936c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:49.185885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d234d8-5e16-48e0-b33f-9b42b54936c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:49.187323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d234d8-5e16-48e0-b33f-9b42b54936c4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-63d234d8-5e16-48e0-b33f-9b42b54936c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:49.205557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:49.206631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:49.208299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:49.208299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:49.208299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:49.208299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:49.208299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 474/936] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:49.213588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36831314-86f3-4ccc-a8a5-c9c19c4062a0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:49.325650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36831314-86f3-4ccc-a8a5-c9c19c4062a0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:49.358257 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:49.363159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453d312-c110-4e30-be6e-5d4ab9fb475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:49.363823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453d312-c110-4e30-be6e-5d4ab9fb475b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:49.364128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453d312-c110-4e30-be6e-5d4ab9fb475b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:49.364398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0453d312-c110-4e30-be6e-5d4ab9fb475b None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:49.365121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453d312-c110-4e30-be6e-5d4ab9fb475b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:49.365419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453d312-c110-4e30-be6e-5d4ab9fb475b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:49.366843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0453d312-c110-4e30-be6e-5d4ab9fb475b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:49.379947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 463/937] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:49.385745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d234d8-5e16-48e0-b33f-9b42b54936c4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:49.433208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:49.493979 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d234d8-5e16-48e0-b33f-9b42b54936c4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:49.530828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fe53b7-b2c3-4014-ab9e-5c7bae843bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:49.531649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe53b7-b2c3-4014-ab9e-5c7bae843bce None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:49.531938 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe53b7-b2c3-4014-ab9e-5c7bae843bce None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:49.532428 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fe53b7-b2c3-4014-ab9e-5c7bae843bce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:49.544540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe53b7-b2c3-4014-ab9e-5c7bae843bce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:49.546045 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fe53b7-b2c3-4014-ab9e-5c7bae843bce None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e3fe53b7-b2c3-4014-ab9e-5c7bae843bce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:49.561574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:49.562566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:49.563494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 475/938] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Jul 20 21:50:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:49.570460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453d312-c110-4e30-be6e-5d4ab9fb475b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:49.573174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9092b-53a7-4319-ba43-3074c57a0ee7 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:49.573459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9092b-53a7-4319-ba43-3074c57a0ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:49.573734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9092b-53a7-4319-ba43-3074c57a0ee7 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:49.578911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 476/939] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:49.581218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45927139-ae70-431c-9020-6ae87189c27a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:49.581701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45927139-ae70-431c-9020-6ae87189c27a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:49.582170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45927139-ae70-431c-9020-6ae87189c27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:49.600473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-45927139-ae70-431c-9020-6ae87189c27a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:49.601997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-45927139-ae70-431c-9020-6ae87189c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:49.684357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 477/940] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:49.702079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45927139-ae70-431c-9020-6ae87189c27a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:49.703159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0453d312-c110-4e30-be6e-5d4ab9fb475b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:49.725494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:49.748780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2d0dc-b8a5-4b05-a1f0-b869ba3678b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:49.749605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2d0dc-b8a5-4b05-a1f0-b869ba3678b3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:49.749988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2d0dc-b8a5-4b05-a1f0-b869ba3678b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:49.750588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2d0dc-b8a5-4b05-a1f0-b869ba3678b3 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:49.751532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2d0dc-b8a5-4b05-a1f0-b869ba3678b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:49.751909 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2d0dc-b8a5-4b05-a1f0-b869ba3678b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:49.753974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e2d0dc-b8a5-4b05-a1f0-b869ba3678b3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:49.782758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 464/941] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Jul 20 21:50:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:49.783833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2d0dc-b8a5-4b05-a1f0-b869ba3678b3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:49.824156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45927139-ae70-431c-9020-6ae87189c27a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:49.840079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:49.860237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:49.860998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:49.861190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:49.861431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:49.862144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:49.863565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:49.865014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WARNING keystone.server.flask.common [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 21:50:49.899202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2d0dc-b8a5-4b05-a1f0-b869ba3678b3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:49.911876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.sql.core [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 21:50:49.911876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 21:50:49.911876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [parameters: {'id': 'df20e3b58b3c4c9b9fc5744887531035', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 21:50:49.911876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80418) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df20e3b58b3c4c9b9fc5744887531035.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df20e3b58b3c4c9b9fc5744887531035. Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application conn.query(q) Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 21:50:49.923359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application result.read() Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 20 21:50:49.924284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application next(self.gen) Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application yield resource Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application next(self.gen) Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise self.value Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application session.commit() Jul 20 21:50:49.925397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.session.flush() Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application compat.raise_( Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 21:50:49.926363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 21:50:49.927316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application conn.query(q) Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application result.read() Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 21:50:49.928266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [parameters: {'id': 'df20e3b58b3c4c9b9fc5744887531035', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:49.930157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:49.938152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:49.940340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:49.940340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 20 21:50:49.940340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 20 21:50:49.940340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:49.940340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:49.940340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 20 21:50:49.940340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 20 21:50:49.940340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id df20e3b58b3c4c9b9fc5744887531035. Jul 20 21:50:49.940340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:49.940340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 478/942] 10.222.0.85 () {60 vars in 1140 bytes} [Wed Jul 20 21:50:49 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:49.942122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:49.960879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5230c-b36b-4ad7-a4da-e327b644779d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:49.961973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5230c-b36b-4ad7-a4da-e327b644779d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:49.963069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5230c-b36b-4ad7-a4da-e327b644779d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:49.963427 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5230c-b36b-4ad7-a4da-e327b644779d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:49.980667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5230c-b36b-4ad7-a4da-e327b644779d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:49.983351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5230c-b36b-4ad7-a4da-e327b644779d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e8b5230c-b36b-4ad7-a4da-e327b644779d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:50.006665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:50.007621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:50.008592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:50.008592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:50.008592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:50.008592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:50.008592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 465/943] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:50.010545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2396d8-d1b0-40e6-a459-579f9ba258c6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.010832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2396d8-d1b0-40e6-a459-579f9ba258c6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.011138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2396d8-d1b0-40e6-a459-579f9ba258c6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.012567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 466/944] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:50.014902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2396d8-d1b0-40e6-a459-579f9ba258c6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:50.040999 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:50.066828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d469151e-e646-418a-93f6-4d4a08fd91ea None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:50.103636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b45b2-3ab9-4941-97e8-11cc0495a779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:50.104487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b45b2-3ab9-4941-97e8-11cc0495a779 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.104860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b45b2-3ab9-4941-97e8-11cc0495a779 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.105137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b45b2-3ab9-4941-97e8-11cc0495a779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.112526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b45b2-3ab9-4941-97e8-11cc0495a779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:50.114204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b45b2-3ab9-4941-97e8-11cc0495a779 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:50.122271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:50.126352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2396d8-d1b0-40e6-a459-579f9ba258c6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3d5b45b2-3ab9-4941-97e8-11cc0495a779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:50.131585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:50.138963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 479/945] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4bd74-04c3-4273-a3b3-f2aca3b85f32 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.139960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4bd74-04c3-4273-a3b3-f2aca3b85f32 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.140838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4bd74-04c3-4273-a3b3-f2aca3b85f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.156659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bbb4bd74-04c3-4273-a3b3-f2aca3b85f32 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:50.158826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bbb4bd74-04c3-4273-a3b3-f2aca3b85f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:50.173064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b403-d531-4598-a30c-41c38d55a2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:50.174656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b403-d531-4598-a30c-41c38d55a2ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.174656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b403-d531-4598-a30c-41c38d55a2ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.174656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df77b403-d531-4598-a30c-41c38d55a2ed None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.175522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77b403-d531-4598-a30c-41c38d55a2ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:50.175835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77b403-d531-4598-a30c-41c38d55a2ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:50.177296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df77b403-d531-4598-a30c-41c38d55a2ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:50.192162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 467/946] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:50.192860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b403-d531-4598-a30c-41c38d55a2ed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:50.244450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 480/947] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:50.246516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4bd74-04c3-4273-a3b3-f2aca3b85f32 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:50.307957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df77b403-d531-4598-a30c-41c38d55a2ed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:50.317545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:50.342621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e7b8e-643e-4919-810d-53d1aa46749d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:50.343279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e7b8e-643e-4919-810d-53d1aa46749d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.343563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e7b8e-643e-4919-810d-53d1aa46749d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.343835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4e7b8e-643e-4919-810d-53d1aa46749d None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.344619 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e7b8e-643e-4919-810d-53d1aa46749d None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:50.344930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e7b8e-643e-4919-810d-53d1aa46749d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:50.346372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4e7b8e-643e-4919-810d-53d1aa46749d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:50.361352 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4bd74-04c3-4273-a3b3-f2aca3b85f32 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:50.375960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 468/948] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:50.375960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e7b8e-643e-4919-810d-53d1aa46749d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:50.392063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:50.423741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b93bf-abfc-4924-92ce-bedf7b86231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:50.424856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b93bf-abfc-4924-92ce-bedf7b86231a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.425265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b93bf-abfc-4924-92ce-bedf7b86231a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.425641 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b93bf-abfc-4924-92ce-bedf7b86231a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.436793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b93bf-abfc-4924-92ce-bedf7b86231a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:50.438634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b93bf-abfc-4924-92ce-bedf7b86231a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-152b93bf-abfc-4924-92ce-bedf7b86231a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:50.458480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:50.459432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:50.460379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:50.460379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:50.460379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:50.460379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:50.460379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:50.460379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:50.460379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:50.460379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:50.467371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 481/949] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:50.468547 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b93bf-abfc-4924-92ce-bedf7b86231a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:50.501092 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4e7b8e-643e-4919-810d-53d1aa46749d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:50.547637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e45b-0513-4288-b092-166158aab625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:50.548911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e45b-0513-4288-b092-166158aab625 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.549196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e45b-0513-4288-b092-166158aab625 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.549495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e45b-0513-4288-b092-166158aab625 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.550112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82e45b-0513-4288-b092-166158aab625 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:50.551491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe82e45b-0513-4288-b092-166158aab625 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fe82e45b-0513-4288-b092-166158aab625 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:50.566225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:50.567295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:50.568423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 469/950] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:50.576162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e45b-0513-4288-b092-166158aab625 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:50.595127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b93bf-abfc-4924-92ce-bedf7b86231a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:50.629717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:50.641627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c0d02-ea86-4a31-99d9-4540856881a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:50.654817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c0d02-ea86-4a31-99d9-4540856881a1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.654817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c0d02-ea86-4a31-99d9-4540856881a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.654817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498c0d02-ea86-4a31-99d9-4540856881a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.654817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c0d02-ea86-4a31-99d9-4540856881a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:50.654817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c0d02-ea86-4a31-99d9-4540856881a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:50.654817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498c0d02-ea86-4a31-99d9-4540856881a1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:50.661394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 482/951] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:50.668401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c0d02-ea86-4a31-99d9-4540856881a1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:50.689865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:50.710973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e45b-0513-4288-b092-166158aab625 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:50.759548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a3ed-e102-4a32-9510-25b6bfd973fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:50.760545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a3ed-e102-4a32-9510-25b6bfd973fe None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.761017 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a3ed-e102-4a32-9510-25b6bfd973fe None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.761426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4128a3ed-e102-4a32-9510-25b6bfd973fe None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.762620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128a3ed-e102-4a32-9510-25b6bfd973fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:50.763146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128a3ed-e102-4a32-9510-25b6bfd973fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:50.764885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4128a3ed-e102-4a32-9510-25b6bfd973fe None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:50.772185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 470/952] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Jul 20 21:50:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:50.779509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a3ed-e102-4a32-9510-25b6bfd973fe None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:50.815103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498c0d02-ea86-4a31-99d9-4540856881a1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:50.855349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349c3d2-08db-4bc1-ad8e-68b46d60e7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:50.856330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349c3d2-08db-4bc1-ad8e-68b46d60e7e2 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.856618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349c3d2-08db-4bc1-ad8e-68b46d60e7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.856887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349c3d2-08db-4bc1-ad8e-68b46d60e7e2 None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/864f16bb01df4ea3866ed68b7f0eb0da/roles/261be7f206d549628e13bb85aeae222a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.859211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349c3d2-08db-4bc1-ad8e-68b46d60e7e2 None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=864f16bb01df4ea3866ed68b7f0eb0da, role_id=261be7f206d549628e13bb85aeae222a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:50.860883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349c3d2-08db-4bc1-ad8e-68b46d60e7e2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:50.898318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4128a3ed-e102-4a32-9510-25b6bfd973fe None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:50.935491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b31442-f36e-4c42-ac98-b6081c71999d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:50.936747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b31442-f36e-4c42-ac98-b6081c71999d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:50.937178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b31442-f36e-4c42-ac98-b6081c71999d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:50.937593 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b31442-f36e-4c42-ac98-b6081c71999d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:50.938442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b31442-f36e-4c42-ac98-b6081c71999d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:50.938889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b31442-f36e-4c42-ac98-b6081c71999d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:50.939780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 483/953] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:50:50 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/864f16bb01df4ea3866ed68b7f0eb0da/roles/261be7f206d549628e13bb85aeae222a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:50:50.940610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b31442-f36e-4c42-ac98-b6081c71999d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:50.955221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 471/954] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Jul 20 21:50:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:50.963405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349c3d2-08db-4bc1-ad8e-68b46d60e7e2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:51.016717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:51.078311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349c3d2-08db-4bc1-ad8e-68b46d60e7e2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:51.116451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5b31-bff7-48b0-bfb7-ede1da28ace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:51.117110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5b31-bff7-48b0-bfb7-ede1da28ace9 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:51.117387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5b31-bff7-48b0-bfb7-ede1da28ace9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:51.117661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba5b31-bff7-48b0-bfb7-ede1da28ace9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:51.118562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba5b31-bff7-48b0-bfb7-ede1da28ace9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:51.119959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba5b31-bff7-48b0-bfb7-ede1da28ace9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:51.153416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb526d72-6dd8-4773-b2b6-8a5525c3005a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:51.153756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb526d72-6dd8-4773-b2b6-8a5525c3005a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:51.154042 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb526d72-6dd8-4773-b2b6-8a5525c3005a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:51.155513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 472/955] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:51.161099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aebf0-389f-4f18-9221-8a399416c533 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:51.161462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aebf0-389f-4f18-9221-8a399416c533 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:51.161855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35aebf0-389f-4f18-9221-8a399416c533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:51.178505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a35aebf0-389f-4f18-9221-8a399416c533 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:51.179682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a35aebf0-389f-4f18-9221-8a399416c533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:51.188105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:51.202461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 484/956] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Jul 20 21:50:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:51.276602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 473/957] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:51.299625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5b31-bff7-48b0-bfb7-ede1da28ace9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:51.408645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:51.412495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba5b31-bff7-48b0-bfb7-ede1da28ace9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:51.449661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b09108-df9e-44d4-899e-b4cece09d9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:51.451297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b09108-df9e-44d4-899e-b4cece09d9de None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:51.451774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b09108-df9e-44d4-899e-b4cece09d9de None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:51.452377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b09108-df9e-44d4-899e-b4cece09d9de None admin] PATH_INFO: `/v3/services/compute` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:51.453328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b09108-df9e-44d4-899e-b4cece09d9de None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:51.455017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b09108-df9e-44d4-899e-b4cece09d9de None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-47b09108-df9e-44d4-899e-b4cece09d9de None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:51.468028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:51.469104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 21:50:51.470026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:51.472354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 485/958] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:51.479575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aebf0-389f-4f18-9221-8a399416c533 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:51.585193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35aebf0-389f-4f18-9221-8a399416c533 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:51.620219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679a821d-197f-4318-a107-de060a242907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:51.620976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a821d-197f-4318-a107-de060a242907 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:51.621255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a821d-197f-4318-a107-de060a242907 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:51.621526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679a821d-197f-4318-a107-de060a242907 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:51.622291 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a821d-197f-4318-a107-de060a242907 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:51.622596 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a821d-197f-4318-a107-de060a242907 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:51.623974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679a821d-197f-4318-a107-de060a242907 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:51.629143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 474/959] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:51.635116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b09108-df9e-44d4-899e-b4cece09d9de None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:51.748618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b09108-df9e-44d4-899e-b4cece09d9de None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:51.783413 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50794673-ca58-45f2-b872-acaccabf5f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:51.784493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50794673-ca58-45f2-b872-acaccabf5f14 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:51.784971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50794673-ca58-45f2-b872-acaccabf5f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:51.785441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50794673-ca58-45f2-b872-acaccabf5f14 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:51.786333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50794673-ca58-45f2-b872-acaccabf5f14 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:51.786843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50794673-ca58-45f2-b872-acaccabf5f14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:51.788430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50794673-ca58-45f2-b872-acaccabf5f14 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:51.799937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 486/960] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:52.606415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece96a8-37c2-4339-bfe7-127edd1b23e2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:52.607189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece96a8-37c2-4339-bfe7-127edd1b23e2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:52.607189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece96a8-37c2-4339-bfe7-127edd1b23e2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:52.608632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 475/961] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:52.613756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec6ddb-bb35-40c3-a1b7-17e850a93ceb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:52.614395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec6ddb-bb35-40c3-a1b7-17e850a93ceb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:52.614395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec6ddb-bb35-40c3-a1b7-17e850a93ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:52.631629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-90ec6ddb-bb35-40c3-a1b7-17e850a93ceb None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:52.632852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-90ec6ddb-bb35-40c3-a1b7-17e850a93ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:52.660470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:52.716875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 487/962] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:52.741295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece96a8-37c2-4339-bfe7-127edd1b23e2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:52.748011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:52.864878 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece96a8-37c2-4339-bfe7-127edd1b23e2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:52.903954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baef47f-1476-4d12-9b13-3ff62dae1c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:52.904864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef47f-1476-4d12-9b13-3ff62dae1c8e None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:52.905292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef47f-1476-4d12-9b13-3ff62dae1c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:52.905756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baef47f-1476-4d12-9b13-3ff62dae1c8e None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:52.906632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baef47f-1476-4d12-9b13-3ff62dae1c8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:52.908309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baef47f-1476-4d12-9b13-3ff62dae1c8e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:52.909817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: WARNING keystone.server.flask.common [None req-3baef47f-1476-4d12-9b13-3ff62dae1c8e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 20 21:50:52.974037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.sql.core [None req-3baef47f-1476-4d12-9b13-3ff62dae1c8e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 21:50:52.974037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 21:50:52.974037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [parameters: {'user_id': 'eb44d3a1629b496daaa811e8ad760f63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 21:50:52.974037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80419) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3baef47f-1476-4d12-9b13-3ff62dae1c8e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() Jul 20 21:50:52.990605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 21:50:52.991513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application yield resource Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.rollback() Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.force_reraise() Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise self.value Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application session.commit() Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 20 21:50:52.992978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._prepare_impl() Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.flush() Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._flush(objects) Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application compat.raise_( Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application flush_context.execute() Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rec.execute(self) Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 20 21:50:52.995298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 20 21:50:52.996813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 20 21:50:52.999007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [parameters: {'user_id': 'eb44d3a1629b496daaa811e8ad760f63', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:53.001068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 20 21:50:53.003016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 20 21:50:53.005392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 20 21:50:53.005392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 20 21:50:53.005392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 20 21:50:53.005392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 20 21:50:53.005392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 20 21:50:53.005392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:53.005392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 476/963] 10.222.0.85 () {60 vars in 1131 bytes} [Wed Jul 20 21:50:52 2022] POST /identity/v3/users => generated 160 bytes in 251 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:53.006332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec6ddb-bb35-40c3-a1b7-17e850a93ceb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:53.107971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec6ddb-bb35-40c3-a1b7-17e850a93ceb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:53.108641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c79d9-39c5-448b-b5cf-b5b4a18c24ef None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.108964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c79d9-39c5-448b-b5cf-b5b4a18c24ef None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.109471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c79d9-39c5-448b-b5cf-b5b4a18c24ef None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.118032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 477/964] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:53.121310 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2267d-d1b8-442a-8b8c-e94feb1d642e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.122097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2267d-d1b8-442a-8b8c-e94feb1d642e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.122612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2267d-d1b8-442a-8b8c-e94feb1d642e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.143955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61870bd-20a1-4db2-a52e-77ad6f19de50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:53.144629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-64c2267d-d1b8-442a-8b8c-e94feb1d642e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:53.144814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61870bd-20a1-4db2-a52e-77ad6f19de50 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.145053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61870bd-20a1-4db2-a52e-77ad6f19de50 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.145325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61870bd-20a1-4db2-a52e-77ad6f19de50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.147342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-64c2267d-d1b8-442a-8b8c-e94feb1d642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:53.152837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61870bd-20a1-4db2-a52e-77ad6f19de50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:53.154279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61870bd-20a1-4db2-a52e-77ad6f19de50 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e61870bd-20a1-4db2-a52e-77ad6f19de50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:53.169109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:53.170119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:53.171638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 488/965] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:50:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:53.176252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61870bd-20a1-4db2-a52e-77ad6f19de50 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:53.195742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:53.224603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:53.241861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 478/966] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:53.264122 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2267d-d1b8-442a-8b8c-e94feb1d642e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:53.285035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61870bd-20a1-4db2-a52e-77ad6f19de50 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:53.322171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd4033-eeb5-49f8-87e8-34a01a4f6dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:53.322674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4033-eeb5-49f8-87e8-34a01a4f6dfa None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.322940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4033-eeb5-49f8-87e8-34a01a4f6dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.323214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd4033-eeb5-49f8-87e8-34a01a4f6dfa None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.324049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd4033-eeb5-49f8-87e8-34a01a4f6dfa None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:53.324403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd4033-eeb5-49f8-87e8-34a01a4f6dfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:53.325832 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd4033-eeb5-49f8-87e8-34a01a4f6dfa None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:53.361650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 489/967] 10.222.0.85 () {56 vars in 1101 bytes} [Wed Jul 20 21:50:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:53.390418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2267d-d1b8-442a-8b8c-e94feb1d642e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:53.433932 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafe626-e48f-4f4a-8522-af71a673c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:53.435022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafe626-e48f-4f4a-8522-af71a673c9db None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.435460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafe626-e48f-4f4a-8522-af71a673c9db None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.435886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfafe626-e48f-4f4a-8522-af71a673c9db None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.449092 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfafe626-e48f-4f4a-8522-af71a673c9db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-dfafe626-e48f-4f4a-8522-af71a673c9db None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:50:53.457862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:53.459080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:50:53.460294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:53.467604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 479/968] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Jul 20 21:50:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:53.473103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd4033-eeb5-49f8-87e8-34a01a4f6dfa None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:53.559673 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:53.585074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd4033-eeb5-49f8-87e8-34a01a4f6dfa None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:53.621559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6911a834-1f2f-4839-8705-4c84eccf2257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:53.622229 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a834-1f2f-4839-8705-4c84eccf2257 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.622508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a834-1f2f-4839-8705-4c84eccf2257 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.622780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6911a834-1f2f-4839-8705-4c84eccf2257 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.623528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911a834-1f2f-4839-8705-4c84eccf2257 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:53.623831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911a834-1f2f-4839-8705-4c84eccf2257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:53.625219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6911a834-1f2f-4839-8705-4c84eccf2257 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:53.634163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 490/969] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Jul 20 21:50:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:53.639511 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafe626-e48f-4f4a-8522-af71a673c9db None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:53.653570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134055a6-360f-4f5d-ac65-95199eaf909a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.653837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134055a6-360f-4f5d-ac65-95199eaf909a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.654058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134055a6-360f-4f5d-ac65-95199eaf909a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.655777 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 491/970] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:53.661744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795edc2-178f-4be8-8d0b-2b999c85eade None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.662035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795edc2-178f-4be8-8d0b-2b999c85eade None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.662317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795edc2-178f-4be8-8d0b-2b999c85eade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.680286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a795edc2-178f-4be8-8d0b-2b999c85eade None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:53.682717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a795edc2-178f-4be8-8d0b-2b999c85eade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:53.704007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:53.750205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfafe626-e48f-4f4a-8522-af71a673c9db None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:53.763086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 492/971] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:53.785202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8c850-b4a7-4d7d-8879-d2aa128dd73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:53.785996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8c850-b4a7-4d7d-8879-d2aa128dd73b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.786169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795edc2-178f-4be8-8d0b-2b999c85eade None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:53.786374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8c850-b4a7-4d7d-8879-d2aa128dd73b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.786548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8c850-b4a7-4d7d-8879-d2aa128dd73b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.798785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8c850-b4a7-4d7d-8879-d2aa128dd73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:53.800403 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8c850-b4a7-4d7d-8879-d2aa128dd73b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-edb8c850-b4a7-4d7d-8879-d2aa128dd73b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:53.817690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:53.818628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:53.819553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:53.819553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:53.819553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:53.819553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:53.819553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 480/972] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:53.824554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8c850-b4a7-4d7d-8879-d2aa128dd73b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:53.862429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:53.896992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795edc2-178f-4be8-8d0b-2b999c85eade None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:53.934150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295181e7-42c6-4a7a-8019-09a0689d0800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:53.934344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8c850-b4a7-4d7d-8879-d2aa128dd73b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:53.934881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295181e7-42c6-4a7a-8019-09a0689d0800 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.935160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295181e7-42c6-4a7a-8019-09a0689d0800 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.935431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295181e7-42c6-4a7a-8019-09a0689d0800 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.936138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295181e7-42c6-4a7a-8019-09a0689d0800 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:53.937515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295181e7-42c6-4a7a-8019-09a0689d0800 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:53.941984 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-295181e7-42c6-4a7a-8019-09a0689d0800 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:53.953208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:53.954211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:53.955083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 493/973] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:53.964357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295181e7-42c6-4a7a-8019-09a0689d0800 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:53.980589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749225e8-29a8-4ef2-9dea-6be9bece67d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:53.981297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749225e8-29a8-4ef2-9dea-6be9bece67d5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:53.981586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749225e8-29a8-4ef2-9dea-6be9bece67d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:53.981863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749225e8-29a8-4ef2-9dea-6be9bece67d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:53.982630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749225e8-29a8-4ef2-9dea-6be9bece67d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:53.982955 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749225e8-29a8-4ef2-9dea-6be9bece67d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:53.984671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749225e8-29a8-4ef2-9dea-6be9bece67d5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:53.999960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 481/974] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:54.003875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749225e8-29a8-4ef2-9dea-6be9bece67d5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:54.076239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295181e7-42c6-4a7a-8019-09a0689d0800 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:54.109361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:54.115441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9c142-dbca-420e-8a12-6779c76de65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:54.117087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9c142-dbca-420e-8a12-6779c76de65d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.117087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9c142-dbca-420e-8a12-6779c76de65d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.117087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9c142-dbca-420e-8a12-6779c76de65d None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.117441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9c142-dbca-420e-8a12-6779c76de65d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:54.117703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9c142-dbca-420e-8a12-6779c76de65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:54.118055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749225e8-29a8-4ef2-9dea-6be9bece67d5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:54.119270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9c142-dbca-420e-8a12-6779c76de65d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:54.124560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 494/975] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Jul 20 21:50:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:54.130350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9c142-dbca-420e-8a12-6779c76de65d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:54.157311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82387da-f952-41a7-be29-16c2379901cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:54.158226 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82387da-f952-41a7-be29-16c2379901cd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.158605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82387da-f952-41a7-be29-16c2379901cd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.158889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82387da-f952-41a7-be29-16c2379901cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.166486 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82387da-f952-41a7-be29-16c2379901cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:54.167948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82387da-f952-41a7-be29-16c2379901cd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c82387da-f952-41a7-be29-16c2379901cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:50:54.183139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:54.184208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:54.185384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:54.185384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:54.185384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:50:54.185384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:50:54.185384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:50:54.185384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:50:54.185384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:50:54.185384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:50:54.185384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 20 21:50:54.185384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:54.189021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 482/976] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Jul 20 21:50:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:54.189956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82387da-f952-41a7-be29-16c2379901cd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:54.220112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:54.244699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9c142-dbca-420e-8a12-6779c76de65d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:54.279668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceed2a1-9330-4438-b06e-4bfe613958dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:54.280351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed2a1-9330-4438-b06e-4bfe613958dd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.280630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed2a1-9330-4438-b06e-4bfe613958dd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.280899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceed2a1-9330-4438-b06e-4bfe613958dd None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.281601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceed2a1-9330-4438-b06e-4bfe613958dd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:54.281906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceed2a1-9330-4438-b06e-4bfe613958dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:54.283258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceed2a1-9330-4438-b06e-4bfe613958dd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:54.288040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 495/977] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Jul 20 21:50:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:54.289247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d34ff-f07a-4e8f-b295-7cc5acc0d686 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.289532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d34ff-f07a-4e8f-b295-7cc5acc0d686 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.289810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d34ff-f07a-4e8f-b295-7cc5acc0d686 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.291211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 496/978] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:54.294013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82387da-f952-41a7-be29-16c2379901cd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:54.294140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d34ff-f07a-4e8f-b295-7cc5acc0d686 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:54.328631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23848cbd-0658-458e-acf5-0353206a59f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:54.329302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23848cbd-0658-458e-acf5-0353206a59f2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.329591 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23848cbd-0658-458e-acf5-0353206a59f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.329874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23848cbd-0658-458e-acf5-0353206a59f2 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.330710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23848cbd-0658-458e-acf5-0353206a59f2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:54.331020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23848cbd-0658-458e-acf5-0353206a59f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:54.332535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23848cbd-0658-458e-acf5-0353206a59f2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:54.350644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 483/979] 10.222.0.85 () {56 vars in 1149 bytes} [Wed Jul 20 21:50:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:54.352004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d83c36-30d1-46b5-9dba-cb9ef0be2598 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.352257 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d83c36-30d1-46b5-9dba-cb9ef0be2598 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.352558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d83c36-30d1-46b5-9dba-cb9ef0be2598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.353303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:54.369494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a9d83c36-30d1-46b5-9dba-cb9ef0be2598 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:54.370739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a9d83c36-30d1-46b5-9dba-cb9ef0be2598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:54.395886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d34ff-f07a-4e8f-b295-7cc5acc0d686 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:54.429437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94488af8-0e6f-46bc-86da-1b0a7c1de774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:54.430091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94488af8-0e6f-46bc-86da-1b0a7c1de774 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.430366 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94488af8-0e6f-46bc-86da-1b0a7c1de774 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.430636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94488af8-0e6f-46bc-86da-1b0a7c1de774 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.431584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94488af8-0e6f-46bc-86da-1b0a7c1de774 None admin] RBAC: Adding query filter params (interface=admin, service_id=b67c804a83f14bb2b3113abe9a78c1e9, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:54.431895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94488af8-0e6f-46bc-86da-1b0a7c1de774 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:54.433379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94488af8-0e6f-46bc-86da-1b0a7c1de774 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:54.438349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 497/980] 10.222.0.85 () {56 vars in 1249 bytes} [Wed Jul 20 21:50:54 2022] GET /identity/v3/endpoints?service_id=b67c804a83f14bb2b3113abe9a78c1e9&interface=admin®ion_id=RegionOne => generated 193 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:54.439590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94488af8-0e6f-46bc-86da-1b0a7c1de774 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:54.442179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 484/981] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:54.443871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d83c36-30d1-46b5-9dba-cb9ef0be2598 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:54.459472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:54.545509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d83c36-30d1-46b5-9dba-cb9ef0be2598 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:54.552535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94488af8-0e6f-46bc-86da-1b0a7c1de774 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:54.575903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:54.581706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b074dbf-0845-48ba-ba97-0543c598ffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:54.582358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b074dbf-0845-48ba-ba97-0543c598ffce None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.582640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b074dbf-0845-48ba-ba97-0543c598ffce None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.582911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b074dbf-0845-48ba-ba97-0543c598ffce None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.583588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b074dbf-0845-48ba-ba97-0543c598ffce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:54.584983 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b074dbf-0845-48ba-ba97-0543c598ffce None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:54.586080 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898b8ba-fde4-4648-82ce-6c0c2830402b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:54.586721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898b8ba-fde4-4648-82ce-6c0c2830402b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.587032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898b8ba-fde4-4648-82ce-6c0c2830402b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.587307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898b8ba-fde4-4648-82ce-6c0c2830402b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.591124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 485/982] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Jul 20 21:50:54 2022] GET /identity/v3/services => generated 1497 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 21:50:54.591906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b074dbf-0845-48ba-ba97-0543c598ffce None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:54.667470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898b8ba-fde4-4648-82ce-6c0c2830402b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:54.669071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898b8ba-fde4-4648-82ce-6c0c2830402b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:54.683870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:54.709077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b074dbf-0845-48ba-ba97-0543c598ffce None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:54.747559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ab26e-c173-494a-b207-9647229502a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:54.748626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ab26e-c173-494a-b207-9647229502a0 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.748626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ab26e-c173-494a-b207-9647229502a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.748900 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ab26e-c173-494a-b207-9647229502a0 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.749627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ab26e-c173-494a-b207-9647229502a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:54.751292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ab26e-c173-494a-b207-9647229502a0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:54.787231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 498/983] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:50:54 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:50:54.793101 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898b8ba-fde4-4648-82ce-6c0c2830402b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:54.817589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:54.833227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 486/984] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:50:54 2022] POST /identity/v3/services => generated 242 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:54.905528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898b8ba-fde4-4648-82ce-6c0c2830402b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:54.957665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746a6fc-a00a-4716-ad74-293480b6b393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:54.958484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746a6fc-a00a-4716-ad74-293480b6b393 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:54.958771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746a6fc-a00a-4716-ad74-293480b6b393 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:54.959051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746a6fc-a00a-4716-ad74-293480b6b393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:54.973851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746a6fc-a00a-4716-ad74-293480b6b393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:54.975320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1746a6fc-a00a-4716-ad74-293480b6b393 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1746a6fc-a00a-4716-ad74-293480b6b393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:50:54.995313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:54.996544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:54.997484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:50:54.997484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:50:54.997484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:50:54.997484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:55.000036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 499/985] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:55.002410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ab26e-c173-494a-b207-9647229502a0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:55.114534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ab26e-c173-494a-b207-9647229502a0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:55.151835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bbf39-f3ee-43e0-8b92-f2584c7983dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:55.152535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bbf39-f3ee-43e0-8b92-f2584c7983dc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:55.152820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bbf39-f3ee-43e0-8b92-f2584c7983dc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:55.153097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bbf39-f3ee-43e0-8b92-f2584c7983dc None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:55.153913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bbf39-f3ee-43e0-8b92-f2584c7983dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:55.154225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bbf39-f3ee-43e0-8b92-f2584c7983dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:55.155706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bbf39-f3ee-43e0-8b92-f2584c7983dc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:55.162968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:55.172959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 487/986] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:55.174509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746a6fc-a00a-4716-ad74-293480b6b393 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:55.252651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:55.282520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746a6fc-a00a-4716-ad74-293480b6b393 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:55.319150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248f6a2-bf9f-448d-97a1-955f4356584e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:55.319961 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248f6a2-bf9f-448d-97a1-955f4356584e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:55.320251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248f6a2-bf9f-448d-97a1-955f4356584e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:55.320524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248f6a2-bf9f-448d-97a1-955f4356584e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:55.327707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248f6a2-bf9f-448d-97a1-955f4356584e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:55.329183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248f6a2-bf9f-448d-97a1-955f4356584e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a248f6a2-bf9f-448d-97a1-955f4356584e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:50:55.344460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:55.345416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:55.346334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:50:55.346334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:50:55.346334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:50:55.346334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:50:55.346334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:50:55.346334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:50:55.346334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:50:55.346334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:55.348306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 500/987] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:55.351372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bbf39-f3ee-43e0-8b92-f2584c7983dc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:55.457743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bbf39-f3ee-43e0-8b92-f2584c7983dc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:55.493172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614bb00e-16b1-443c-a2fc-f6c3743e6753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:55.494231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bb00e-16b1-443c-a2fc-f6c3743e6753 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:55.494741 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bb00e-16b1-443c-a2fc-f6c3743e6753 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:55.495224 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614bb00e-16b1-443c-a2fc-f6c3743e6753 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:55.496300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bb00e-16b1-443c-a2fc-f6c3743e6753 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:55.496811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bb00e-16b1-443c-a2fc-f6c3743e6753 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:55.498436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614bb00e-16b1-443c-a2fc-f6c3743e6753 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:55.511878 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 488/988] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:55.517661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248f6a2-bf9f-448d-97a1-955f4356584e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:55.622944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248f6a2-bf9f-448d-97a1-955f4356584e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:55.653508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:55.659206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8f2a9-e75b-4f8a-af70-4adfd7960c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:55.659862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f2a9-e75b-4f8a-af70-4adfd7960c41 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:55.660174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f2a9-e75b-4f8a-af70-4adfd7960c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:55.660454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8f2a9-e75b-4f8a-af70-4adfd7960c41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:55.661338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8f2a9-e75b-4f8a-af70-4adfd7960c41 None admin] RBAC: Adding query filter params (role.id=261be7f206d549628e13bb85aeae222a, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=864f16bb01df4ea3866ed68b7f0eb0da) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:55.661724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8f2a9-e75b-4f8a-af70-4adfd7960c41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:55.669256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8f2a9-e75b-4f8a-af70-4adfd7960c41 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:55.669815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 501/989] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:50:55 2022] GET /identity/v3/role_assignments?user.id=864f16bb01df4ea3866ed68b7f0eb0da&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=261be7f206d549628e13bb85aeae222a => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:56.673405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fe75a-4569-49d2-b840-a894f6fd3e50 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:56.673972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fe75a-4569-49d2-b840-a894f6fd3e50 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:56.673972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2fe75a-4569-49d2-b840-a894f6fd3e50 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:56.675467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 489/990] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:56.680600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4bd93-4304-4787-8ff3-c9ea933eb906 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:56.681499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4bd93-4304-4787-8ff3-c9ea933eb906 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:56.681751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb4bd93-4304-4787-8ff3-c9ea933eb906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:56.699429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bcb4bd93-4304-4787-8ff3-c9ea933eb906 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:56.700947 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bcb4bd93-4304-4787-8ff3-c9ea933eb906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:56.770590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 502/991] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:56.794990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fe75a-4569-49d2-b840-a894f6fd3e50 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:56.863046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:56.907369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d799d1-7d0f-42a3-9da9-6535cddb5547 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:56.907659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d799d1-7d0f-42a3-9da9-6535cddb5547 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:56.907962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d799d1-7d0f-42a3-9da9-6535cddb5547 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:56.909350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 503/992] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:56.914271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39ad7b-d3ae-48c9-9d60-8443635eedd2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:56.914595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39ad7b-d3ae-48c9-9d60-8443635eedd2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:56.914904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c39ad7b-d3ae-48c9-9d60-8443635eedd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:56.918296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2fe75a-4569-49d2-b840-a894f6fd3e50 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:56.932378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3c39ad7b-d3ae-48c9-9d60-8443635eedd2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:56.933498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3c39ad7b-d3ae-48c9-9d60-8443635eedd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:56.954162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b52906-8ef7-4bc6-bda1-6443e6fe6e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:56.954968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52906-8ef7-4bc6-bda1-6443e6fe6e65 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:56.955246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52906-8ef7-4bc6-bda1-6443e6fe6e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:56.955515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b52906-8ef7-4bc6-bda1-6443e6fe6e65 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:56.956210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b52906-8ef7-4bc6-bda1-6443e6fe6e65 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:56.957618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b52906-8ef7-4bc6-bda1-6443e6fe6e65 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c2b52906-8ef7-4bc6-bda1-6443e6fe6e65 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:56.975865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:56.976934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:56.978870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 490/993] 10.222.0.85 () {56 vars in 1126 bytes} [Wed Jul 20 21:50:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:56.983902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b52906-8ef7-4bc6-bda1-6443e6fe6e65 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:57.028067 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 504/994] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:57.047570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39ad7b-d3ae-48c9-9d60-8443635eedd2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:57.105169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:57.105960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b52906-8ef7-4bc6-bda1-6443e6fe6e65 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:57.131929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:57.147238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eda642-152f-4144-bb8f-9a153ab26109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:57.148122 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eda642-152f-4144-bb8f-9a153ab26109 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:57.148724 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eda642-152f-4144-bb8f-9a153ab26109 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:57.149196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eda642-152f-4144-bb8f-9a153ab26109 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:57.151045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eda642-152f-4144-bb8f-9a153ab26109 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:57.151385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eda642-152f-4144-bb8f-9a153ab26109 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:57.151835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c39ad7b-d3ae-48c9-9d60-8443635eedd2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:57.152815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eda642-152f-4144-bb8f-9a153ab26109 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:57.158476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 491/995] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Jul 20 21:50:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:57.163705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eda642-152f-4144-bb8f-9a153ab26109 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:57.189620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bab31-7bb0-4e78-81a4-849bf5b0d70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:57.190437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bab31-7bb0-4e78-81a4-849bf5b0d70f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:57.190721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bab31-7bb0-4e78-81a4-849bf5b0d70f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:57.191045 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342bab31-7bb0-4e78-81a4-849bf5b0d70f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:57.191702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bab31-7bb0-4e78-81a4-849bf5b0d70f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:57.193096 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342bab31-7bb0-4e78-81a4-849bf5b0d70f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-342bab31-7bb0-4e78-81a4-849bf5b0d70f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:57.206068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:57.207108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:50:57.208648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 505/996] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:50:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:50:57.213820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bab31-7bb0-4e78-81a4-849bf5b0d70f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:57.277616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eda642-152f-4144-bb8f-9a153ab26109 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:57.310491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6942436-9d6a-4eae-8f3e-967997f94995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:57.311164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942436-9d6a-4eae-8f3e-967997f94995 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:57.311438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942436-9d6a-4eae-8f3e-967997f94995 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:57.311712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6942436-9d6a-4eae-8f3e-967997f94995 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:57.312459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6942436-9d6a-4eae-8f3e-967997f94995 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:57.312763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6942436-9d6a-4eae-8f3e-967997f94995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:57.314145 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6942436-9d6a-4eae-8f3e-967997f94995 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:57.319249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 492/997] 10.222.0.85 () {56 vars in 1122 bytes} [Wed Jul 20 21:50:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:57.325314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6942436-9d6a-4eae-8f3e-967997f94995 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:57.329765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342bab31-7bb0-4e78-81a4-849bf5b0d70f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:57.351453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:57.368465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e629fbc-487f-4ba6-9438-47855afa5f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:57.369133 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629fbc-487f-4ba6-9438-47855afa5f8f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:57.369411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629fbc-487f-4ba6-9438-47855afa5f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:57.369679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e629fbc-487f-4ba6-9438-47855afa5f8f None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:57.370910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e629fbc-487f-4ba6-9438-47855afa5f8f None admin] RBAC: Adding query filter params (name=compute) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:57.371308 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e629fbc-487f-4ba6-9438-47855afa5f8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:57.372618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e629fbc-487f-4ba6-9438-47855afa5f8f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:57.379963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 506/998] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:57.384194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e629fbc-487f-4ba6-9438-47855afa5f8f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:57.387137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:57.443094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6942436-9d6a-4eae-8f3e-967997f94995 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:57.481279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1cdb8-bc4e-4a6a-9417-4ffcd42ea982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:57.482006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1cdb8-bc4e-4a6a-9417-4ffcd42ea982 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:57.482222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1cdb8-bc4e-4a6a-9417-4ffcd42ea982 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:57.482494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1cdb8-bc4e-4a6a-9417-4ffcd42ea982 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:57.483234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1cdb8-bc4e-4a6a-9417-4ffcd42ea982 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:57.484638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1cdb8-bc4e-4a6a-9417-4ffcd42ea982 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:57.493916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e629fbc-487f-4ba6-9438-47855afa5f8f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:57.529238 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf1757-56e8-4360-b8d9-98bd3cbaada2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:57.529891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf1757-56e8-4360-b8d9-98bd3cbaada2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:57.530168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf1757-56e8-4360-b8d9-98bd3cbaada2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:57.530433 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf1757-56e8-4360-b8d9-98bd3cbaada2 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:57.531125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf1757-56e8-4360-b8d9-98bd3cbaada2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:57.531423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf1757-56e8-4360-b8d9-98bd3cbaada2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:57.532794 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf1757-56e8-4360-b8d9-98bd3cbaada2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:57.537713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 507/999] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:50:57 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:57.543533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf1757-56e8-4360-b8d9-98bd3cbaada2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:57.579240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 493/1000] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Jul 20 21:50:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:50:57.597824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:57.657210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf1757-56e8-4360-b8d9-98bd3cbaada2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:57.701417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383a91b-7e9f-48b4-aaa5-4f7712fd7a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:57.702051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a91b-7e9f-48b4-aaa5-4f7712fd7a16 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:57.702306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a91b-7e9f-48b4-aaa5-4f7712fd7a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:57.702539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383a91b-7e9f-48b4-aaa5-4f7712fd7a16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:57.703338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383a91b-7e9f-48b4-aaa5-4f7712fd7a16 None admin] RBAC: Adding query filter params (interface=public, service_id=ce914f0915b64946b1d8bd4a2e9c94a5, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:57.703644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383a91b-7e9f-48b4-aaa5-4f7712fd7a16 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:57.705046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383a91b-7e9f-48b4-aaa5-4f7712fd7a16 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:57.710952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 508/1001] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Jul 20 21:50:57 2022] GET /identity/v3/endpoints?service_id=ce914f0915b64946b1d8bd4a2e9c94a5&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:50:57.716639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1cdb8-bc4e-4a6a-9417-4ffcd42ea982 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:57.826334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244c53b-3db3-4465-ae4d-d94edef96a24 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:57.826683 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244c53b-3db3-4465-ae4d-d94edef96a24 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:57.826888 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7244c53b-3db3-4465-ae4d-d94edef96a24 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:57.828386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 509/1002] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:57.831807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1cdb8-bc4e-4a6a-9417-4ffcd42ea982 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:57.833491 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358678c-df9a-441c-b70e-20e94c19af4d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:57.833785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358678c-df9a-441c-b70e-20e94c19af4d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:57.834068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5358678c-df9a-441c-b70e-20e94c19af4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:57.843798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:57.851769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5358678c-df9a-441c-b70e-20e94c19af4d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:57.853047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5358678c-df9a-441c-b70e-20e94c19af4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:57.869180 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a7afd-2dde-4ec7-a430-e62bc55aa39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:57.869873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a7afd-2dde-4ec7-a430-e62bc55aa39d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:57.870158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a7afd-2dde-4ec7-a430-e62bc55aa39d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:57.870429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a7afd-2dde-4ec7-a430-e62bc55aa39d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:57.871123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a7afd-2dde-4ec7-a430-e62bc55aa39d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:57.872532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a7afd-2dde-4ec7-a430-e62bc55aa39d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:57.879255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 494/1003] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Jul 20 21:50:57 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 21:50:57.933906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 510/1004] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:57 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:50:57.957015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a7afd-2dde-4ec7-a430-e62bc55aa39d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:58.074103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a7afd-2dde-4ec7-a430-e62bc55aa39d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:58.108529 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a057dea-ab65-46c9-bb9f-1f5dd7893771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:58.109317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a057dea-ab65-46c9-bb9f-1f5dd7893771 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:58.109598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a057dea-ab65-46c9-bb9f-1f5dd7893771 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:58.109866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a057dea-ab65-46c9-bb9f-1f5dd7893771 None admin] PATH_INFO: `/v3/services/image` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:58.110515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a057dea-ab65-46c9-bb9f-1f5dd7893771 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:58.111889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a057dea-ab65-46c9-bb9f-1f5dd7893771 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6a057dea-ab65-46c9-bb9f-1f5dd7893771 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:50:58.123985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:50:58.125019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:50:58.126027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 495/1005] 10.222.0.85 () {56 vars in 1105 bytes} [Wed Jul 20 21:50:57 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:50:58.131226 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358678c-df9a-441c-b70e-20e94c19af4d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:58.176337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:58.238078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5358678c-df9a-441c-b70e-20e94c19af4d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:58.273800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548ff03-e95c-4459-9055-0d03bf268c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:58.275162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548ff03-e95c-4459-9055-0d03bf268c76 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:58.275598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548ff03-e95c-4459-9055-0d03bf268c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:58.275878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548ff03-e95c-4459-9055-0d03bf268c76 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:58.276639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548ff03-e95c-4459-9055-0d03bf268c76 None admin] RBAC: Adding query filter params (name=image) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:58.276950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548ff03-e95c-4459-9055-0d03bf268c76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:58.278317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548ff03-e95c-4459-9055-0d03bf268c76 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:58.283438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 511/1006] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:58.288917 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a057dea-ab65-46c9-bb9f-1f5dd7893771 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:58.330586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:58.400039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a057dea-ab65-46c9-bb9f-1f5dd7893771 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:58.435450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89a32e-32fc-48c0-955c-86150f4857b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:58.436139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89a32e-32fc-48c0-955c-86150f4857b9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:58.436423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89a32e-32fc-48c0-955c-86150f4857b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:58.436748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89a32e-32fc-48c0-955c-86150f4857b9 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:58.437454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89a32e-32fc-48c0-955c-86150f4857b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:50:58.437758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89a32e-32fc-48c0-955c-86150f4857b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:58.439121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89a32e-32fc-48c0-955c-86150f4857b9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:58.452230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 496/1007] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:58 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:59.679871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d629f-115c-4ffa-a80c-e8c092cd5ae0 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:59.681023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d629f-115c-4ffa-a80c-e8c092cd5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:59.681023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824d629f-115c-4ffa-a80c-e8c092cd5ae0 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:59.682380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 512/1008] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:50:59.687861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63a0e-92c7-4275-a230-a59242a35677 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:59.688341 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63a0e-92c7-4275-a230-a59242a35677 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:59.688514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f63a0e-92c7-4275-a230-a59242a35677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:59.705687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c3f63a0e-92c7-4275-a230-a59242a35677 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:59.706870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c3f63a0e-92c7-4275-a230-a59242a35677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:59.776707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 497/1009] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:50:59.800556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d629f-115c-4ffa-a80c-e8c092cd5ae0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:59.908009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824d629f-115c-4ffa-a80c-e8c092cd5ae0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:50:59.909548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:50:59.933878 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6db951-528f-4b18-938d-df239d12a40c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:59.934063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6db951-528f-4b18-938d-df239d12a40c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:59.934342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6db951-528f-4b18-938d-df239d12a40c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:59.935852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 498/1010] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:50:59.940789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33955-06a0-4628-864a-e387f0d19792 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:59.941097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33955-06a0-4628-864a-e387f0d19792 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:59.941352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf33955-06a0-4628-864a-e387f0d19792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:59.943127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5826e1-4ad0-4a09-b3a3-7a70ffc21db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:50:59.944365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5826e1-4ad0-4a09-b3a3-7a70ffc21db6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:50:59.944997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5826e1-4ad0-4a09-b3a3-7a70ffc21db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:50:59.945763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5826e1-4ad0-4a09-b3a3-7a70ffc21db6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:50:59.947679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5826e1-4ad0-4a09-b3a3-7a70ffc21db6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:50:59.949152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5826e1-4ad0-4a09-b3a3-7a70ffc21db6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:50:59.952155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 513/1011] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:50:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:50:59.956313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5826e1-4ad0-4a09-b3a3-7a70ffc21db6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:50:59.967960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4bf33955-06a0-4628-864a-e387f0d19792 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:50:59.968525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4bf33955-06a0-4628-864a-e387f0d19792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:50:59.998287 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:00.047406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 499/1012] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:50:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:51:00.069836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf33955-06a0-4628-864a-e387f0d19792 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:00.081709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5826e1-4ad0-4a09-b3a3-7a70ffc21db6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:00.122251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32d1b4-54c8-4d56-a386-29fb257351ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:00.122914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32d1b4-54c8-4d56-a386-29fb257351ef None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:00.123197 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32d1b4-54c8-4d56-a386-29fb257351ef None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:00.123473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32d1b4-54c8-4d56-a386-29fb257351ef None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:00.124219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32d1b4-54c8-4d56-a386-29fb257351ef None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:00.125652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32d1b4-54c8-4d56-a386-29fb257351ef None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:00.181017 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf33955-06a0-4628-864a-e387f0d19792 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:00.217617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187ec50-e69c-492e-a76a-20249fdd09b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:00.218364 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187ec50-e69c-492e-a76a-20249fdd09b7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:00.218611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187ec50-e69c-492e-a76a-20249fdd09b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:00.218904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f187ec50-e69c-492e-a76a-20249fdd09b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:00.219545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187ec50-e69c-492e-a76a-20249fdd09b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:00.221087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f187ec50-e69c-492e-a76a-20249fdd09b7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:00.227685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 514/1013] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:50:59 2022] POST /identity/v3/projects => generated 311 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f187ec50-e69c-492e-a76a-20249fdd09b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:00.233415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:00.234471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:00.240735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 500/1014] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:51:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:00.244460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32d1b4-54c8-4d56-a386-29fb257351ef None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:00.275673 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:00.362318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32d1b4-54c8-4d56-a386-29fb257351ef None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:00.401351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e3c05-80e3-445d-8d9b-cc7407e5b65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:00.402021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e3c05-80e3-445d-8d9b-cc7407e5b65c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:00.402342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e3c05-80e3-445d-8d9b-cc7407e5b65c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:00.402597 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e3c05-80e3-445d-8d9b-cc7407e5b65c None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:00.403307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e3c05-80e3-445d-8d9b-cc7407e5b65c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:00.403613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e3c05-80e3-445d-8d9b-cc7407e5b65c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:00.405015 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e3c05-80e3-445d-8d9b-cc7407e5b65c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:00.410046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 515/1015] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:51:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:00.416101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187ec50-e69c-492e-a76a-20249fdd09b7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:00.446887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:00.523950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f187ec50-e69c-492e-a76a-20249fdd09b7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:00.533440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b08a32-96c4-4120-8a93-5f3e1d2d0e2b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:00.533763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b08a32-96c4-4120-8a93-5f3e1d2d0e2b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:00.534044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b08a32-96c4-4120-8a93-5f3e1d2d0e2b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:00.535653 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 516/1016] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:51:00.541093 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48365b2-9d98-4e86-b067-ab6088059034 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:00.541390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48365b2-9d98-4e86-b067-ab6088059034 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:00.541667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48365b2-9d98-4e86-b067-ab6088059034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:00.560292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c48365b2-9d98-4e86-b067-ab6088059034 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:00.561470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05f1aa-5f4a-4d2f-ad03-d935ec360f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:00.561623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c48365b2-9d98-4e86-b067-ab6088059034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:00.562138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05f1aa-5f4a-4d2f-ad03-d935ec360f46 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:00.562418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05f1aa-5f4a-4d2f-ad03-d935ec360f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:00.562690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05f1aa-5f4a-4d2f-ad03-d935ec360f46 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:00.563404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05f1aa-5f4a-4d2f-ad03-d935ec360f46 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:00.563707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05f1aa-5f4a-4d2f-ad03-d935ec360f46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:00.565121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05f1aa-5f4a-4d2f-ad03-d935ec360f46 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:00.572069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 501/1017] 10.222.0.85 () {56 vars in 1112 bytes} [Wed Jul 20 21:51:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:00.575808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05f1aa-5f4a-4d2f-ad03-d935ec360f46 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:00.635887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 517/1018] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:00 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:51:00.660236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48365b2-9d98-4e86-b067-ab6088059034 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:00.670794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:00.680204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:00.683867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05f1aa-5f4a-4d2f-ad03-d935ec360f46 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:00.728250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ac16f-2fe6-4e34-a03f-43a8c2ce99de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:00.729052 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ac16f-2fe6-4e34-a03f-43a8c2ce99de None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:00.729159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ac16f-2fe6-4e34-a03f-43a8c2ce99de None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:00.729420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ac16f-2fe6-4e34-a03f-43a8c2ce99de None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:00.730149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ac16f-2fe6-4e34-a03f-43a8c2ce99de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:00.731512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ac16f-2fe6-4e34-a03f-43a8c2ce99de None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:00.766845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48365b2-9d98-4e86-b067-ab6088059034 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:00.805109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007de685-95c0-45ab-8b7d-76e8c69153ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:00.805109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007de685-95c0-45ab-8b7d-76e8c69153ec None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:00.805109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007de685-95c0-45ab-8b7d-76e8c69153ec None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:00.805109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007de685-95c0-45ab-8b7d-76e8c69153ec None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:00.806096 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007de685-95c0-45ab-8b7d-76e8c69153ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:00.806096 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007de685-95c0-45ab-8b7d-76e8c69153ec None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:00.847428 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 502/1019] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Jul 20 21:51:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 21:51:00.954569 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 518/1020] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:51:00 2022] POST /identity/v3/services => generated 242 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:51:02.383751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ca197-5cdb-4c1a-9043-d8ec943e8a30 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:02.384326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ca197-5cdb-4c1a-9043-d8ec943e8a30 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:02.384326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469ca197-5cdb-4c1a-9043-d8ec943e8a30 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:02.387960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 503/1021] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:02.391362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21580fa8-645d-48ea-9a06-7317d1dcf9c7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:02.391754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21580fa8-645d-48ea-9a06-7317d1dcf9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:02.391989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21580fa8-645d-48ea-9a06-7317d1dcf9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:02.409116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-21580fa8-645d-48ea-9a06-7317d1dcf9c7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:02.410325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-21580fa8-645d-48ea-9a06-7317d1dcf9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:02.487021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 519/1022] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:02.512196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ca197-5cdb-4c1a-9043-d8ec943e8a30 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:02.623180 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469ca197-5cdb-4c1a-9043-d8ec943e8a30 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:02.658196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e30818-0464-44a0-9ebd-6075d4873439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:02.658904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e30818-0464-44a0-9ebd-6075d4873439 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:02.659183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e30818-0464-44a0-9ebd-6075d4873439 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:02.659456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e30818-0464-44a0-9ebd-6075d4873439 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:02.660790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e30818-0464-44a0-9ebd-6075d4873439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:02.662232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e30818-0464-44a0-9ebd-6075d4873439 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:02.669318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 504/1023] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:02.670545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21580fa8-645d-48ea-9a06-7317d1dcf9c7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:02.672729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:02.773835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21580fa8-645d-48ea-9a06-7317d1dcf9c7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:02.809401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534b9d03-161b-4264-8ffa-7d0e4b8fa1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:02.810064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b9d03-161b-4264-8ffa-7d0e4b8fa1be None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:02.810343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b9d03-161b-4264-8ffa-7d0e4b8fa1be None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:02.810614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b9d03-161b-4264-8ffa-7d0e4b8fa1be None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:02.811451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b9d03-161b-4264-8ffa-7d0e4b8fa1be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:02.812898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534b9d03-161b-4264-8ffa-7d0e4b8fa1be None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:03.003553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 520/1024] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:51:02 2022] POST /identity/v3/users => generated 285 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:51:03.018254 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c760-4fd2-4ebf-a2d3-bd5b61407044 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.018598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c760-4fd2-4ebf-a2d3-bd5b61407044 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.018811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c760-4fd2-4ebf-a2d3-bd5b61407044 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.020536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 505/1025] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:03.026740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c3d2-b3be-4532-a304-5f6138c51c0f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.027055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c3d2-b3be-4532-a304-5f6138c51c0f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.027315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c3d2-b3be-4532-a304-5f6138c51c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.045734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8df4c3d2-b3be-4532-a304-5f6138c51c0f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:03.047025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8df4c3d2-b3be-4532-a304-5f6138c51c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:03.058431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ea86-b4ea-463a-bfc5-2e31e07d04fd None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.058725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ea86-b4ea-463a-bfc5-2e31e07d04fd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.059006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7238ea86-b4ea-463a-bfc5-2e31e07d04fd None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.060481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 506/1026] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:03.066346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd480c84-54cf-48f4-b9f4-90372712c149 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.066632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd480c84-54cf-48f4-b9f4-90372712c149 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.066917 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd480c84-54cf-48f4-b9f4-90372712c149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.086470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cd480c84-54cf-48f4-b9f4-90372712c149 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:03.088833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cd480c84-54cf-48f4-b9f4-90372712c149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:03.099785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:03.112470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:03.127973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 521/1027] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:51:03.153960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4c3d2-b3be-4532-a304-5f6138c51c0f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:03.176617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 507/1028] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:51:03.213944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd480c84-54cf-48f4-b9f4-90372712c149 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:03.272852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4c3d2-b3be-4532-a304-5f6138c51c0f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:03.310188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf047e-9378-4da8-b71a-9f6e9658b8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:03.311001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf047e-9378-4da8-b71a-9f6e9658b8dc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.311282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf047e-9378-4da8-b71a-9f6e9658b8dc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.311468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd480c84-54cf-48f4-b9f4-90372712c149 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:03.311570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf047e-9378-4da8-b71a-9f6e9658b8dc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.323424 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf047e-9378-4da8-b71a-9f6e9658b8dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-8dcf047e-9378-4da8-b71a-9f6e9658b8dc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:03.332412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:03.333473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:51:03.334326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:03.339075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 522/1029] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Jul 20 21:51:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:03.340038 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf047e-9378-4da8-b71a-9f6e9658b8dc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:03.354136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1cc98-d11c-48dc-91bf-949f3e52b73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:03.354934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1cc98-d11c-48dc-91bf-949f3e52b73c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.355223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1cc98-d11c-48dc-91bf-949f3e52b73c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.355495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1cc98-d11c-48dc-91bf-949f3e52b73c None admin] PATH_INFO: `/v3/services/image` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.356177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1cc98-d11c-48dc-91bf-949f3e52b73c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:03.357559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1cc98-d11c-48dc-91bf-949f3e52b73c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f2f1cc98-d11c-48dc-91bf-949f3e52b73c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:03.369961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:03.371025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:03.371892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 508/1030] 10.222.0.85 () {56 vars in 1105 bytes} [Wed Jul 20 21:51:03 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:03.377044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1cc98-d11c-48dc-91bf-949f3e52b73c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:03.388747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:03.402629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:03.457695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf047e-9378-4da8-b71a-9f6e9658b8dc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:03.488307 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1cc98-d11c-48dc-91bf-949f3e52b73c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:03.493944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3284e7-bb94-4aae-b6b1-3b8c8fc9a5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:03.494692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3284e7-bb94-4aae-b6b1-3b8c8fc9a5bc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.494974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3284e7-bb94-4aae-b6b1-3b8c8fc9a5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.495246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3284e7-bb94-4aae-b6b1-3b8c8fc9a5bc None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.496017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3284e7-bb94-4aae-b6b1-3b8c8fc9a5bc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:03.496329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3284e7-bb94-4aae-b6b1-3b8c8fc9a5bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:03.497696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3284e7-bb94-4aae-b6b1-3b8c8fc9a5bc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:03.505948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 523/1031] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Jul 20 21:51:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:03.512329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3284e7-bb94-4aae-b6b1-3b8c8fc9a5bc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:03.528458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0f4c-57fd-496f-84d4-8b995815e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:03.529124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0f4c-57fd-496f-84d4-8b995815e22d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.529409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0f4c-57fd-496f-84d4-8b995815e22d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.529676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fa0f4c-57fd-496f-84d4-8b995815e22d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.530392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0f4c-57fd-496f-84d4-8b995815e22d None admin] RBAC: Adding query filter params (name=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:03.530698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0f4c-57fd-496f-84d4-8b995815e22d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:03.532112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fa0f4c-57fd-496f-84d4-8b995815e22d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:03.537125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 509/1032] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:03.543396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0f4c-57fd-496f-84d4-8b995815e22d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:03.624226 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:03.625735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3284e7-bb94-4aae-b6b1-3b8c8fc9a5bc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:03.637160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:03.654151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fa0f4c-57fd-496f-84d4-8b995815e22d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:03.666788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30871dc-92db-40dd-8464-0b90d20f812e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:03.667579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30871dc-92db-40dd-8464-0b90d20f812e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.667947 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30871dc-92db-40dd-8464-0b90d20f812e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.668165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30871dc-92db-40dd-8464-0b90d20f812e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.679690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30871dc-92db-40dd-8464-0b90d20f812e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:03.682066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30871dc-92db-40dd-8464-0b90d20f812e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:03.692872 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168406a-bbbe-4a45-824e-61d3927f24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:03.693543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168406a-bbbe-4a45-824e-61d3927f24be None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.693827 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168406a-bbbe-4a45-824e-61d3927f24be None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.694104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168406a-bbbe-4a45-824e-61d3927f24be None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.694813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168406a-bbbe-4a45-824e-61d3927f24be None admin] RBAC: Adding query filter params (type=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:03.695118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168406a-bbbe-4a45-824e-61d3927f24be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:03.696770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168406a-bbbe-4a45-824e-61d3927f24be None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c30871dc-92db-40dd-8464-0b90d20f812e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:51:03.701333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:03.702310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:03.703249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:51:03.703249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:51:03.703249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:03.703249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:03.703486 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 510/1033] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:03.707892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168406a-bbbe-4a45-824e-61d3927f24be None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:03.710237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 524/1034] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:03.711068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30871dc-92db-40dd-8464-0b90d20f812e None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:03.817523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168406a-bbbe-4a45-824e-61d3927f24be None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:03.826310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30871dc-92db-40dd-8464-0b90d20f812e None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:03.856205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809957a5-8d9b-4701-a5d9-4d80a103c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:03.856864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809957a5-8d9b-4701-a5d9-4d80a103c980 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.857146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809957a5-8d9b-4701-a5d9-4d80a103c980 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.857460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809957a5-8d9b-4701-a5d9-4d80a103c980 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.858205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809957a5-8d9b-4701-a5d9-4d80a103c980 None admin] RBAC: Adding query filter params (interface=public, service_id=bc29afdf84c8444ea97395acc902298b, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:03.863051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809957a5-8d9b-4701-a5d9-4d80a103c980 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:03.863051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809957a5-8d9b-4701-a5d9-4d80a103c980 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:03.863259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6d2ba-eab9-472d-9c92-d858671e5932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:03.863364 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:03.863480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6d2ba-eab9-472d-9c92-d858671e5932 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:03.863766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6d2ba-eab9-472d-9c92-d858671e5932 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:03.864076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b6d2ba-eab9-472d-9c92-d858671e5932 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:03.864805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6d2ba-eab9-472d-9c92-d858671e5932 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:03.865117 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6d2ba-eab9-472d-9c92-d858671e5932 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:03.866517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b6d2ba-eab9-472d-9c92-d858671e5932 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:03.872393 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 511/1035] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Jul 20 21:51:03 2022] GET /identity/v3/endpoints?service_id=bc29afdf84c8444ea97395acc902298b&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:03.873144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809957a5-8d9b-4701-a5d9-4d80a103c980 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:03.885545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 525/1036] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:03.891614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6d2ba-eab9-472d-9c92-d858671e5932 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:03.922820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:03.986545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809957a5-8d9b-4701-a5d9-4d80a103c980 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:04.010472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b6d2ba-eab9-472d-9c92-d858671e5932 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:04.027824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec17a80-27db-44f2-ba04-cb8a3f70cf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:04.028567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec17a80-27db-44f2-ba04-cb8a3f70cf4a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:04.028861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec17a80-27db-44f2-ba04-cb8a3f70cf4a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:04.029126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec17a80-27db-44f2-ba04-cb8a3f70cf4a None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:04.029816 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec17a80-27db-44f2-ba04-cb8a3f70cf4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:04.031187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec17a80-27db-44f2-ba04-cb8a3f70cf4a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:04.047341 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 512/1037] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Jul 20 21:51:03 2022] GET /identity/v3/services => generated 1957 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 21:51:04.058367 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c016b-aaf3-4fbb-86d9-4b64bd10c9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:04.059188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c016b-aaf3-4fbb-86d9-4b64bd10c9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:04.059469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c016b-aaf3-4fbb-86d9-4b64bd10c9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:04.059744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c016b-aaf3-4fbb-86d9-4b64bd10c9f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:04.068489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c016b-aaf3-4fbb-86d9-4b64bd10c9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:04.069890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c016b-aaf3-4fbb-86d9-4b64bd10c9f2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-019c016b-aaf3-4fbb-86d9-4b64bd10c9f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:51:04.086283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:04.093827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:04.094925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 526/1038] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Jul 20 21:51:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:04.096748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec17a80-27db-44f2-ba04-cb8a3f70cf4a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:04.167324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:04.214540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec17a80-27db-44f2-ba04-cb8a3f70cf4a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:04.252246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19e912-e54d-4569-b7f4-b5298cdf9e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:04.252928 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19e912-e54d-4569-b7f4-b5298cdf9e6a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:04.253213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19e912-e54d-4569-b7f4-b5298cdf9e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:04.253548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae19e912-e54d-4569-b7f4-b5298cdf9e6a None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:04.254398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19e912-e54d-4569-b7f4-b5298cdf9e6a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:04.254744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19e912-e54d-4569-b7f4-b5298cdf9e6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:04.256218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae19e912-e54d-4569-b7f4-b5298cdf9e6a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:04.275343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 513/1039] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Jul 20 21:51:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:04.280916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c016b-aaf3-4fbb-86d9-4b64bd10c9f2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:04.365531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:04.385430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c016b-aaf3-4fbb-86d9-4b64bd10c9f2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:04.420620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b5b4b-8981-4fcb-acef-0cdf90f2088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:04.421258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b5b4b-8981-4fcb-acef-0cdf90f2088a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:04.421539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b5b4b-8981-4fcb-acef-0cdf90f2088a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:04.421815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128b5b4b-8981-4fcb-acef-0cdf90f2088a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:04.489905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b5b4b-8981-4fcb-acef-0cdf90f2088a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:04.491357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128b5b4b-8981-4fcb-acef-0cdf90f2088a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:04.576655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:04.596501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 527/1040] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:04.602139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19e912-e54d-4569-b7f4-b5298cdf9e6a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:04.710192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae19e912-e54d-4569-b7f4-b5298cdf9e6a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:04.733679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:04.746103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af08881-1be0-40f2-87f2-2ca96e6aef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:04.746890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af08881-1be0-40f2-87f2-2ca96e6aef2e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:04.747168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af08881-1be0-40f2-87f2-2ca96e6aef2e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:04.747510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af08881-1be0-40f2-87f2-2ca96e6aef2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:04.758021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af08881-1be0-40f2-87f2-2ca96e6aef2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:04.760431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af08881-1be0-40f2-87f2-2ca96e6aef2e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9af08881-1be0-40f2-87f2-2ca96e6aef2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:51:04.779456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:04.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:04.781327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:51:04.781327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:51:04.781327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:04.781327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:04.781327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 514/1041] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:04.787430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b5b4b-8981-4fcb-acef-0cdf90f2088a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:04.891932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128b5b4b-8981-4fcb-acef-0cdf90f2088a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:04.928313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d104b33-0718-4966-981c-c130473a3cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:04.928976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d104b33-0718-4966-981c-c130473a3cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:04.929259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d104b33-0718-4966-981c-c130473a3cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:04.929537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d104b33-0718-4966-981c-c130473a3cc2 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:04.930782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d104b33-0718-4966-981c-c130473a3cc2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:04.931322 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d104b33-0718-4966-981c-c130473a3cc2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:04.932820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d104b33-0718-4966-981c-c130473a3cc2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:04.951107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 528/1042] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:04.952151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af08881-1be0-40f2-87f2-2ca96e6aef2e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:05.060196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af08881-1be0-40f2-87f2-2ca96e6aef2e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:05.094810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c2a07-5e4a-4ae6-b4aa-af69444940cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:05.095601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c2a07-5e4a-4ae6-b4aa-af69444940cd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:05.095882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c2a07-5e4a-4ae6-b4aa-af69444940cd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:05.096183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c2a07-5e4a-4ae6-b4aa-af69444940cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:05.104118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c2a07-5e4a-4ae6-b4aa-af69444940cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:05.105605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c2a07-5e4a-4ae6-b4aa-af69444940cd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ac2c2a07-5e4a-4ae6-b4aa-af69444940cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:51:05.120648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:05.121568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:05.122484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:51:05.122484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:51:05.122484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:51:05.122484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:51:05.122484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:51:05.122484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:51:05.122484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:51:05.122484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:05.122484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 515/1043] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:51:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:05.128836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d104b33-0718-4966-981c-c130473a3cc2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:05.173449 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74881f-5d8f-4ae5-b90a-01c74ef5d116 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:05.173771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74881f-5d8f-4ae5-b90a-01c74ef5d116 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:05.174004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74881f-5d8f-4ae5-b90a-01c74ef5d116 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:05.175511 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 516/1044] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:51:05.177294 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:05.181768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b759e-f005-4bf9-b862-4264a828c8a1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:05.182083 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b759e-f005-4bf9-b862-4264a828c8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:05.182320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b759e-f005-4bf9-b862-4264a828c8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:05.200283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ba8b759e-f005-4bf9-b862-4264a828c8a1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:05.201516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ba8b759e-f005-4bf9-b862-4264a828c8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:05.234073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:05.244902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d104b33-0718-4966-981c-c130473a3cc2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:05.280262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 517/1045] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:51:05.281698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d93c-4d91-47fb-8cb3-ba6f410a22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:05.282391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d93c-4d91-47fb-8cb3-ba6f410a22ed None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:05.283073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d93c-4d91-47fb-8cb3-ba6f410a22ed None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:05.283073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d93c-4d91-47fb-8cb3-ba6f410a22ed None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:05.283730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d93c-4d91-47fb-8cb3-ba6f410a22ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:05.284137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d93c-4d91-47fb-8cb3-ba6f410a22ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:05.285573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d93c-4d91-47fb-8cb3-ba6f410a22ed None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:05.298966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 529/1046] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:51:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:05.304008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b759e-f005-4bf9-b862-4264a828c8a1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:05.304841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d93c-4d91-47fb-8cb3-ba6f410a22ed None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:05.410274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d93c-4d91-47fb-8cb3-ba6f410a22ed None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:05.411675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:05.417912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b759e-f005-4bf9-b862-4264a828c8a1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:05.444497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee340db-7e46-4290-aa5a-f9a52efd6f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:05.445150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee340db-7e46-4290-aa5a-f9a52efd6f62 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:05.445429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee340db-7e46-4290-aa5a-f9a52efd6f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:05.445720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee340db-7e46-4290-aa5a-f9a52efd6f62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:05.446629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee340db-7e46-4290-aa5a-f9a52efd6f62 None admin] RBAC: Adding query filter params (role.id=261be7f206d549628e13bb85aeae222a, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=5e192a50b09b49b4b7db2508ecf75af5) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:05.446940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee340db-7e46-4290-aa5a-f9a52efd6f62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:05.448423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee340db-7e46-4290-aa5a-f9a52efd6f62 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:05.453735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e099-3bc3-451d-a154-8188e060b44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:05.454519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e099-3bc3-451d-a154-8188e060b44f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:05.454798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e099-3bc3-451d-a154-8188e060b44f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:05.455140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2e099-3bc3-451d-a154-8188e060b44f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:05.460484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 530/1047] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:51:05 2022] GET /identity/v3/role_assignments?user.id=5e192a50b09b49b4b7db2508ecf75af5&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=261be7f206d549628e13bb85aeae222a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:05.467774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b2e099-3bc3-451d-a154-8188e060b44f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d4b2e099-3bc3-451d-a154-8188e060b44f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:05.475721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:05.476938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:05.478399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:05.480292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 518/1048] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:05.484132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee340db-7e46-4290-aa5a-f9a52efd6f62 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:05.594544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee340db-7e46-4290-aa5a-f9a52efd6f62 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:05.632981 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7708fd-ba39-408d-888c-7a889aaeab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:05.633791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7708fd-ba39-408d-888c-7a889aaeab14 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:05.634142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7708fd-ba39-408d-888c-7a889aaeab14 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:05.634422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7708fd-ba39-408d-888c-7a889aaeab14 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:05.635223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7708fd-ba39-408d-888c-7a889aaeab14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:05.635534 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7708fd-ba39-408d-888c-7a889aaeab14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:05.636933 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7708fd-ba39-408d-888c-7a889aaeab14 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:05.651198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 531/1049] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:05.652866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e099-3bc3-451d-a154-8188e060b44f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:05.684163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:05.774678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b2e099-3bc3-451d-a154-8188e060b44f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:05.809915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ddb40-35a7-437b-931b-37a2bc9bbe24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:05.810784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ddb40-35a7-437b-931b-37a2bc9bbe24 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:05.811121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ddb40-35a7-437b-931b-37a2bc9bbe24 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:05.811539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ddb40-35a7-437b-931b-37a2bc9bbe24 None admin] PATH_INFO: `/v3/users/6f4cceed3e7a4f6ea8f642554e1393df` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:05.826514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ddb40-35a7-437b-931b-37a2bc9bbe24 None admin] RBAC: Authorizing `identity:get_user(user_id=6f4cceed3e7a4f6ea8f642554e1393df)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:05.828012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ddb40-35a7-437b-931b-37a2bc9bbe24 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:05.830094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 519/1050] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:05 2022] GET /identity/v3/users/6f4cceed3e7a4f6ea8f642554e1393df => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:05.835591 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7708fd-ba39-408d-888c-7a889aaeab14 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:05.864942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:05.938816 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7708fd-ba39-408d-888c-7a889aaeab14 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:05.978202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3344b-d005-434f-8ee5-bf5e42ebecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:05.978857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3344b-d005-434f-8ee5-bf5e42ebecd3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:05.979139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3344b-d005-434f-8ee5-bf5e42ebecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:05.979412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e3344b-d005-434f-8ee5-bf5e42ebecd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:06.049887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3344b-d005-434f-8ee5-bf5e42ebecd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:06.051328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e3344b-d005-434f-8ee5-bf5e42ebecd3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:06.078723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:06.137932 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304efef-d883-4620-9302-c5311736ef9c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:06.138261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304efef-d883-4620-9302-c5311736ef9c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:06.138492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1304efef-d883-4620-9302-c5311736ef9c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:06.139947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 520/1051] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:51:06.144990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd985018-c883-496f-a66d-481927a930f5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:06.145282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd985018-c883-496f-a66d-481927a930f5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:06.145559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd985018-c883-496f-a66d-481927a930f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:06.159063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 532/1052] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:05 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:06.160829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3344b-d005-434f-8ee5-bf5e42ebecd3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:06.163137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fd985018-c883-496f-a66d-481927a930f5 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:06.164369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fd985018-c883-496f-a66d-481927a930f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:06.247871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 521/1053] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:51:06.271283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd985018-c883-496f-a66d-481927a930f5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:06.283379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e3344b-d005-434f-8ee5-bf5e42ebecd3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:06.285353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:06.316871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:06.327911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41d311-eadf-450c-8701-4c11761f8fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:06.328855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d311-eadf-450c-8701-4c11761f8fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:06.329135 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d311-eadf-450c-8701-4c11761f8fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:06.329431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41d311-eadf-450c-8701-4c11761f8fa4 None admin] PATH_INFO: `/v3/projects/d957b9cb133b477e97b5f96d8703e21f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:06.330624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41d311-eadf-450c-8701-4c11761f8fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=d957b9cb133b477e97b5f96d8703e21f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:06.332099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41d311-eadf-450c-8701-4c11761f8fa4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:06.334112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 533/1054] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:06 2022] GET /identity/v3/projects/d957b9cb133b477e97b5f96d8703e21f => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:06.340284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41d311-eadf-450c-8701-4c11761f8fa4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:06.391884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd985018-c883-496f-a66d-481927a930f5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:06.428189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7d50e-26bb-4273-bd79-f249eee18caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:06.428977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7d50e-26bb-4273-bd79-f249eee18caf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:06.429258 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7d50e-26bb-4273-bd79-f249eee18caf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:06.429530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f7d50e-26bb-4273-bd79-f249eee18caf None admin] PATH_INFO: `/v3/services/image` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:06.430724 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7d50e-26bb-4273-bd79-f249eee18caf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:06.432294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f7d50e-26bb-4273-bd79-f249eee18caf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:06.443477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41d311-eadf-450c-8701-4c11761f8fa4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b2f7d50e-26bb-4273-bd79-f249eee18caf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:06.443903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:06.444905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:06.446578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 522/1055] 10.222.0.85 () {56 vars in 1105 bytes} [Wed Jul 20 21:51:06 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:06.451698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7d50e-26bb-4273-bd79-f249eee18caf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:06.481764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd8771-cbcb-46c8-9ca2-b9684005a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:06.482420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd8771-cbcb-46c8-9ca2-b9684005a984 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:06.482674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd8771-cbcb-46c8-9ca2-b9684005a984 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:06.482945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcd8771-cbcb-46c8-9ca2-b9684005a984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:06.483771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd8771-cbcb-46c8-9ca2-b9684005a984 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=d957b9cb133b477e97b5f96d8703e21f, user.id=6f4cceed3e7a4f6ea8f642554e1393df) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:06.484111 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd8771-cbcb-46c8-9ca2-b9684005a984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:06.485526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcd8771-cbcb-46c8-9ca2-b9684005a984 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:06.491130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 534/1056] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:51:06 2022] GET /identity/v3/role_assignments?user.id=6f4cceed3e7a4f6ea8f642554e1393df&scope.project.id=d957b9cb133b477e97b5f96d8703e21f&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:06.550690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:06.577413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f7d50e-26bb-4273-bd79-f249eee18caf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:06.618788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e03e8b-603e-44ba-8d0c-7420452d9dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:06.619656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03e8b-603e-44ba-8d0c-7420452d9dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:06.619950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03e8b-603e-44ba-8d0c-7420452d9dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:06.620227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e03e8b-603e-44ba-8d0c-7420452d9dd0 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:06.620950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03e8b-603e-44ba-8d0c-7420452d9dd0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:06.621255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03e8b-603e-44ba-8d0c-7420452d9dd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:06.622715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e03e8b-603e-44ba-8d0c-7420452d9dd0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:06.633351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 523/1057] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:06.634615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd8771-cbcb-46c8-9ca2-b9684005a984 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:06.700957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:06.745578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcd8771-cbcb-46c8-9ca2-b9684005a984 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:06.779738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338494f4-2db1-4e17-8e64-c4de4d7ba82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:06.780422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338494f4-2db1-4e17-8e64-c4de4d7ba82c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:06.780704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338494f4-2db1-4e17-8e64-c4de4d7ba82c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:06.780980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338494f4-2db1-4e17-8e64-c4de4d7ba82c None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:06.781686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338494f4-2db1-4e17-8e64-c4de4d7ba82c None admin] RBAC: Adding query filter params (type=image) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:06.781992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338494f4-2db1-4e17-8e64-c4de4d7ba82c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:06.783348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338494f4-2db1-4e17-8e64-c4de4d7ba82c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:06.793701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 535/1058] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:06.795080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e03e8b-603e-44ba-8d0c-7420452d9dd0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:06.901297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e03e8b-603e-44ba-8d0c-7420452d9dd0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:06.940828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc4b019-4f51-49fc-bd57-4dc5d5ce15bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:06.941501 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4b019-4f51-49fc-bd57-4dc5d5ce15bc None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:06.941789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4b019-4f51-49fc-bd57-4dc5d5ce15bc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:06.942066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc4b019-4f51-49fc-bd57-4dc5d5ce15bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:06.943976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4b019-4f51-49fc-bd57-4dc5d5ce15bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:06.945518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc4b019-4f51-49fc-bd57-4dc5d5ce15bc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:06.953889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:07.072000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 524/1059] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Jul 20 21:51:06 2022] POST /identity/v3/endpoints => generated 327 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:51:07.538358 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5629b6-480c-4ec0-92be-2e575c893cf7 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:07.538911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5629b6-480c-4ec0-92be-2e575c893cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:07.538911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5629b6-480c-4ec0-92be-2e575c893cf7 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:07.541079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 536/1060] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:07.546528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ffd7-18a6-441a-81df-0d4a751c4d88 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:07.547000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ffd7-18a6-441a-81df-0d4a751c4d88 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:07.547289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4ffd7-18a6-441a-81df-0d4a751c4d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:07.565665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-32d4ffd7-18a6-441a-81df-0d4a751c4d88 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:07.566866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-32d4ffd7-18a6-441a-81df-0d4a751c4d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:07.646746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 525/1061] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:07.675103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5629b6-480c-4ec0-92be-2e575c893cf7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:07.785417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5629b6-480c-4ec0-92be-2e575c893cf7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:07.810791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:07.822538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8c9b7-78cf-49fe-a65b-e26decb9f9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:07.823351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8c9b7-78cf-49fe-a65b-e26decb9f9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:07.823633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8c9b7-78cf-49fe-a65b-e26decb9f9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:07.823909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8c9b7-78cf-49fe-a65b-e26decb9f9f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:07.834217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba8c9b7-78cf-49fe-a65b-e26decb9f9f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-dba8c9b7-78cf-49fe-a65b-e26decb9f9f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:07.843528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:07.844672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:51:07.845918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:07.848244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 537/1062] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Jul 20 21:51:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:07.851003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4ffd7-18a6-441a-81df-0d4a751c4d88 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:07.958360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4ffd7-18a6-441a-81df-0d4a751c4d88 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:07.986517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:07.998536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aca14-84d7-4cb0-b896-9ebdbd6bc832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:08.010129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aca14-84d7-4cb0-b896-9ebdbd6bc832 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:08.010129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aca14-84d7-4cb0-b896-9ebdbd6bc832 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:08.010129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1aca14-84d7-4cb0-b896-9ebdbd6bc832 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:08.010129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1aca14-84d7-4cb0-b896-9ebdbd6bc832 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:08.010129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1aca14-84d7-4cb0-b896-9ebdbd6bc832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:08.010129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1aca14-84d7-4cb0-b896-9ebdbd6bc832 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:08.012231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 526/1063] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Jul 20 21:51:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:08.016274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8c9b7-78cf-49fe-a65b-e26decb9f9f8 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:08.118955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba8c9b7-78cf-49fe-a65b-e26decb9f9f8 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:08.154393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787b5a-15b5-48be-b964-3e71610de1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:08.155183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787b5a-15b5-48be-b964-3e71610de1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:08.155464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787b5a-15b5-48be-b964-3e71610de1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:08.155739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32787b5a-15b5-48be-b964-3e71610de1e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:08.167048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787b5a-15b5-48be-b964-3e71610de1e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:08.168536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32787b5a-15b5-48be-b964-3e71610de1e7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-32787b5a-15b5-48be-b964-3e71610de1e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:51:08.185605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:08.186551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:08.187451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:51:08.187451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:51:08.187451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:08.187451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:08.191911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 538/1064] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:08.193178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aca14-84d7-4cb0-b896-9ebdbd6bc832 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:08.301819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1aca14-84d7-4cb0-b896-9ebdbd6bc832 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:08.335796 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba6ebb6-7ade-4bb6-9cc9-2ca7cfd300c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:08.337024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6ebb6-7ade-4bb6-9cc9-2ca7cfd300c0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:08.337301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6ebb6-7ade-4bb6-9cc9-2ca7cfd300c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:08.337572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba6ebb6-7ade-4bb6-9cc9-2ca7cfd300c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:08.338286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6ebb6-7ade-4bb6-9cc9-2ca7cfd300c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:08.338586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6ebb6-7ade-4bb6-9cc9-2ca7cfd300c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:08.339970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba6ebb6-7ade-4bb6-9cc9-2ca7cfd300c0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:08.356412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 527/1065] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:08.358033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787b5a-15b5-48be-b964-3e71610de1e7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:08.409588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:08.476660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32787b5a-15b5-48be-b964-3e71610de1e7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:08.510441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c443a-bb17-4247-ac54-e5793e9dcf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:08.511236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c443a-bb17-4247-ac54-e5793e9dcf67 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:08.511519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c443a-bb17-4247-ac54-e5793e9dcf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:08.511866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3c443a-bb17-4247-ac54-e5793e9dcf67 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:08.518935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7ac78-5e8d-4fe5-9bf3-6b1278f797e9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:08.519189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7ac78-5e8d-4fe5-9bf3-6b1278f797e9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:08.519454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e7ac78-5e8d-4fe5-9bf3-6b1278f797e9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:08.520199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c443a-bb17-4247-ac54-e5793e9dcf67 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:08.520985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 528/1066] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:08.521729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3c443a-bb17-4247-ac54-e5793e9dcf67 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:08.525743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236dbd8-7b9b-4ba4-8752-06072cdccdf4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:08.526088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236dbd8-7b9b-4ba4-8752-06072cdccdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:08.526280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3236dbd8-7b9b-4ba4-8752-06072cdccdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-5e3c443a-bb17-4247-ac54-e5793e9dcf67 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:51:08.537741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:08.539269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:08.540792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 539/1067] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Jul 20 21:51:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:08.545163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c443a-bb17-4247-ac54-e5793e9dcf67 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:08.547776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3236dbd8-7b9b-4ba4-8752-06072cdccdf4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:08.549274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3236dbd8-7b9b-4ba4-8752-06072cdccdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:08.593115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:08.628081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 529/1068] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:51:08.644285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236dbd8-7b9b-4ba4-8752-06072cdccdf4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:08.653444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:08.659348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3c443a-bb17-4247-ac54-e5793e9dcf67 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:08.696467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f56fd-1ad9-4778-95ec-6e3b656dd1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:08.697055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f56fd-1ad9-4778-95ec-6e3b656dd1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:08.697329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f56fd-1ad9-4778-95ec-6e3b656dd1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:08.697597 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f56fd-1ad9-4778-95ec-6e3b656dd1c6 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:08.698433 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f56fd-1ad9-4778-95ec-6e3b656dd1c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:08.698749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f56fd-1ad9-4778-95ec-6e3b656dd1c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:08.700174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f56fd-1ad9-4778-95ec-6e3b656dd1c6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:08.720153 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 540/1069] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Jul 20 21:51:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:08.726605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f56fd-1ad9-4778-95ec-6e3b656dd1c6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:08.756542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3236dbd8-7b9b-4ba4-8752-06072cdccdf4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:08.793581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74698c8-ffc2-479a-9a08-8500dd21e569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:08.794513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74698c8-ffc2-479a-9a08-8500dd21e569 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:08.794838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74698c8-ffc2-479a-9a08-8500dd21e569 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:08.795063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74698c8-ffc2-479a-9a08-8500dd21e569 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:08.806261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74698c8-ffc2-479a-9a08-8500dd21e569 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d74698c8-ffc2-479a-9a08-8500dd21e569 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:08.814592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:08.815555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:08.816444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 530/1070] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:51:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:08.821734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74698c8-ffc2-479a-9a08-8500dd21e569 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:08.838361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f56fd-1ad9-4778-95ec-6e3b656dd1c6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:08.857971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:08.878079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d49c0e-56f0-4c14-b600-7d833db66344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:08.878877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d49c0e-56f0-4c14-b600-7d833db66344 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:08.879170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d49c0e-56f0-4c14-b600-7d833db66344 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:08.879462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d49c0e-56f0-4c14-b600-7d833db66344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:08.890889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d49c0e-56f0-4c14-b600-7d833db66344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:08.893042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d49c0e-56f0-4c14-b600-7d833db66344 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e6d49c0e-56f0-4c14-b600-7d833db66344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:51:08.911118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:08.912119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:08.913147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:51:08.913147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:51:08.913147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:08.913147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:08.913147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 541/1071] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:08.918818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d49c0e-56f0-4c14-b600-7d833db66344 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:08.929936 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:08.931502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74698c8-ffc2-479a-9a08-8500dd21e569 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:08.979763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ea55-05a4-4bd8-a587-cd2d76c2e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:08.981125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ea55-05a4-4bd8-a587-cd2d76c2e878 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:08.981621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ea55-05a4-4bd8-a587-cd2d76c2e878 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:08.982044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a9ea55-05a4-4bd8-a587-cd2d76c2e878 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:08.983021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ea55-05a4-4bd8-a587-cd2d76c2e878 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:08.983336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ea55-05a4-4bd8-a587-cd2d76c2e878 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:08.984743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a9ea55-05a4-4bd8-a587-cd2d76c2e878 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:08.994430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 531/1072] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:51:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:09.000353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ea55-05a4-4bd8-a587-cd2d76c2e878 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:09.041081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d49c0e-56f0-4c14-b600-7d833db66344 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:09.078799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a44b3-904f-4df4-9d68-d2543b8ab116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:09.079459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a44b3-904f-4df4-9d68-d2543b8ab116 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.079742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a44b3-904f-4df4-9d68-d2543b8ab116 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.080045 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a44b3-904f-4df4-9d68-d2543b8ab116 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.080763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a44b3-904f-4df4-9d68-d2543b8ab116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:09.081066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a44b3-904f-4df4-9d68-d2543b8ab116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:09.082581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a44b3-904f-4df4-9d68-d2543b8ab116 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:09.094624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 542/1073] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:09.099956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a44b3-904f-4df4-9d68-d2543b8ab116 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:09.105761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:09.112488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a9ea55-05a4-4bd8-a587-cd2d76c2e878 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:09.151066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9a02a-34db-480c-b58b-2097546feeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:09.151959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9a02a-34db-480c-b58b-2097546feeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.152248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9a02a-34db-480c-b58b-2097546feeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.152637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9a02a-34db-480c-b58b-2097546feeb9 None admin] PATH_INFO: `/v3/users/6f4cceed3e7a4f6ea8f642554e1393df` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.153851 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9a02a-34db-480c-b58b-2097546feeb9 None admin] RBAC: Authorizing `identity:get_user(user_id=6f4cceed3e7a4f6ea8f642554e1393df)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:09.155288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9a02a-34db-480c-b58b-2097546feeb9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:09.157278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 532/1074] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:08 2022] GET /identity/v3/users/6f4cceed3e7a4f6ea8f642554e1393df => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:09.163337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9a02a-34db-480c-b58b-2097546feeb9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:09.173679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:09.209013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a44b3-904f-4df4-9d68-d2543b8ab116 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:09.243684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6d603-07ab-43f2-8f71-e65fc8618884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:09.244503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d603-07ab-43f2-8f71-e65fc8618884 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.244779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d603-07ab-43f2-8f71-e65fc8618884 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.245051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6d603-07ab-43f2-8f71-e65fc8618884 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.251597 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6d603-07ab-43f2-8f71-e65fc8618884 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:09.253066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6d603-07ab-43f2-8f71-e65fc8618884 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-adc6d603-07ab-43f2-8f71-e65fc8618884 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:51:09.267986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:09.269169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:09.270091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:51:09.270091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:51:09.270091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:51:09.270091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:51:09.270091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:51:09.270091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:51:09.270091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:51:09.270091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:09.270091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 543/1075] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:51:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:09.270611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9a02a-34db-480c-b58b-2097546feeb9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:09.270687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4db10-afdb-4047-a189-b42a50337169 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.270687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4db10-afdb-4047-a189-b42a50337169 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.270997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4db10-afdb-4047-a189-b42a50337169 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.272218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 544/1076] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:09.275338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4db10-afdb-4047-a189-b42a50337169 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:09.307533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0828899d-41a4-4aa3-bb87-9c05c4eec18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:09.308417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828899d-41a4-4aa3-bb87-9c05c4eec18d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.308706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828899d-41a4-4aa3-bb87-9c05c4eec18d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.308979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0828899d-41a4-4aa3-bb87-9c05c4eec18d None admin] PATH_INFO: `/v3/projects/d957b9cb133b477e97b5f96d8703e21f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.310134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828899d-41a4-4aa3-bb87-9c05c4eec18d None admin] RBAC: Authorizing `identity:get_project(project_id=d957b9cb133b477e97b5f96d8703e21f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:09.311571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0828899d-41a4-4aa3-bb87-9c05c4eec18d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:09.313300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 533/1077] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:09 2022] GET /identity/v3/projects/d957b9cb133b477e97b5f96d8703e21f => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:09.314534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f61e-168d-42b4-aefc-19f29ff9d095 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.314825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f61e-168d-42b4-aefc-19f29ff9d095 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.315102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351f61e-168d-42b4-aefc-19f29ff9d095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.332451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c351f61e-168d-42b4-aefc-19f29ff9d095 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:09.333640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c351f61e-168d-42b4-aefc-19f29ff9d095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:09.360227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:09.379962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4db10-afdb-4047-a189-b42a50337169 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:09.402618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 534/1078] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:09.403456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f61e-168d-42b4-aefc-19f29ff9d095 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:09.407802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:09.421073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0105c5b-fbf2-454a-b642-8911e1a95dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:09.422287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0105c5b-fbf2-454a-b642-8911e1a95dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.422287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0105c5b-fbf2-454a-b642-8911e1a95dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.422287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0105c5b-fbf2-454a-b642-8911e1a95dc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.422720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0105c5b-fbf2-454a-b642-8911e1a95dc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:09.423003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0105c5b-fbf2-454a-b642-8911e1a95dc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:09.424535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0105c5b-fbf2-454a-b642-8911e1a95dc6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:09.436592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 545/1079] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:51:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:09.437414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0105c5b-fbf2-454a-b642-8911e1a95dc6 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:09.512006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351f61e-168d-42b4-aefc-19f29ff9d095 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:09.538185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0105c5b-fbf2-454a-b642-8911e1a95dc6 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:09.546745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b9bda-21ea-4fc8-92c7-b181ef996ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:09.547631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9bda-21ea-4fc8-92c7-b181ef996ce1 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.547902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9bda-21ea-4fc8-92c7-b181ef996ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.548198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b9bda-21ea-4fc8-92c7-b181ef996ce1 None admin] PATH_INFO: `/v3/projects/d957b9cb133b477e97b5f96d8703e21f/users/6f4cceed3e7a4f6ea8f642554e1393df/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.550156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b9bda-21ea-4fc8-92c7-b181ef996ce1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d957b9cb133b477e97b5f96d8703e21f, user_id=6f4cceed3e7a4f6ea8f642554e1393df, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:09.551576 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b9bda-21ea-4fc8-92c7-b181ef996ce1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:09.573020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b0d7-735a-466b-b6c5-c6722d6a1e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:09.573669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b0d7-735a-466b-b6c5-c6722d6a1e57 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.573952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b0d7-735a-466b-b6c5-c6722d6a1e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.574259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8350b0d7-735a-466b-b6c5-c6722d6a1e57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.608155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 535/1080] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:51:09 2022] PUT /identity/v3/projects/d957b9cb133b477e97b5f96d8703e21f/users/6f4cceed3e7a4f6ea8f642554e1393df/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:51:09.609037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b9bda-21ea-4fc8-92c7-b181ef996ce1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:09.639379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:09.642919 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:09.664555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350b0d7-735a-466b-b6c5-c6722d6a1e57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:09.666930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8350b0d7-735a-466b-b6c5-c6722d6a1e57 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:09.734856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b9bda-21ea-4fc8-92c7-b181ef996ce1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:09.779814 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b633684-76bd-4963-8711-210fbbacab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:09.780664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b633684-76bd-4963-8711-210fbbacab08 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.780943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b633684-76bd-4963-8711-210fbbacab08 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.781218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b633684-76bd-4963-8711-210fbbacab08 None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/5e192a50b09b49b4b7db2508ecf75af5/roles/261be7f206d549628e13bb85aeae222a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.783489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b633684-76bd-4963-8711-210fbbacab08 None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=5e192a50b09b49b4b7db2508ecf75af5, role_id=261be7f206d549628e13bb85aeae222a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:09.784958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b633684-76bd-4963-8711-210fbbacab08 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:09.794839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 546/1081] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:09.800803 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b0d7-735a-466b-b6c5-c6722d6a1e57 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:09.860539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 536/1082] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:51:09 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/5e192a50b09b49b4b7db2508ecf75af5/roles/261be7f206d549628e13bb85aeae222a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:51:09.900994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:09.917923 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8350b0d7-735a-466b-b6c5-c6722d6a1e57 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:09.965381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878e5f24-1564-4142-a5c1-50023b7849fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:09.966199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e5f24-1564-4142-a5c1-50023b7849fc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:09.966484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e5f24-1564-4142-a5c1-50023b7849fc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:09.966758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e5f24-1564-4142-a5c1-50023b7849fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:09.979282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e5f24-1564-4142-a5c1-50023b7849fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:09.980810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878e5f24-1564-4142-a5c1-50023b7849fc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-878e5f24-1564-4142-a5c1-50023b7849fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:51:10.000708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:10.001906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:10.002841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:51:10.002841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:51:10.002841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:10.002841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:10.003812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 547/1083] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:10.008849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b633684-76bd-4963-8711-210fbbacab08 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:10.100081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:10.119594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b633684-76bd-4963-8711-210fbbacab08 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:10.156595 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b35243-418b-49a0-9e51-552e4f641e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:10.157508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35243-418b-49a0-9e51-552e4f641e4d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:10.157646 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35243-418b-49a0-9e51-552e4f641e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:10.157823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35243-418b-49a0-9e51-552e4f641e4d None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:10.158527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b35243-418b-49a0-9e51-552e4f641e4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:10.158835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b35243-418b-49a0-9e51-552e4f641e4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:10.160248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b35243-418b-49a0-9e51-552e4f641e4d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:10.180418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 537/1084] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:11.662263 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410b433-18b8-4963-a87c-11ba797972a8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:11.662796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410b433-18b8-4963-a87c-11ba797972a8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:11.662796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410b433-18b8-4963-a87c-11ba797972a8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:11.664218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 548/1085] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:11.669848 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d8fe6-0aec-4fb0-b9fc-891b600fd4f0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:11.670298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d8fe6-0aec-4fb0-b9fc-891b600fd4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:11.670401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d8fe6-0aec-4fb0-b9fc-891b600fd4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:11.687658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-320d8fe6-0aec-4fb0-b9fc-891b600fd4f0 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:11.688876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-320d8fe6-0aec-4fb0-b9fc-891b600fd4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:11.759416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 538/1086] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:11.782727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410b433-18b8-4963-a87c-11ba797972a8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:11.884236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410b433-18b8-4963-a87c-11ba797972a8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:11.918668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1759d67-517d-4a57-b245-2549379415df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:11.919368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1759d67-517d-4a57-b245-2549379415df None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:11.919648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1759d67-517d-4a57-b245-2549379415df None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:11.919941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1759d67-517d-4a57-b245-2549379415df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:11.926633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:11.930989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1759d67-517d-4a57-b245-2549379415df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:11.937473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3b250-7a5b-48ad-8159-7cbf6ccbd61d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:11.937751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3b250-7a5b-48ad-8159-7cbf6ccbd61d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:11.941379 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3b250-7a5b-48ad-8159-7cbf6ccbd61d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a1759d67-517d-4a57-b245-2549379415df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:11.941497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:11.942579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:11.943596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:11.944648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 539/1087] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:11.944748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 549/1088] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:51:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:11.944839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04dc42-14ae-4c10-a6c2-637af814783e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:11.944839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04dc42-14ae-4c10-a6c2-637af814783e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:11.945046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04dc42-14ae-4c10-a6c2-637af814783e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:11.946089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1759d67-517d-4a57-b245-2549379415df None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:11.962168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cb04dc42-14ae-4c10-a6c2-637af814783e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:11.963443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb04dc42-14ae-4c10-a6c2-637af814783e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:12.030357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 540/1089] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:12.048642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1759d67-517d-4a57-b245-2549379415df None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:12.054165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04dc42-14ae-4c10-a6c2-637af814783e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:12.057578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:12.082703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd78b9-23ce-4914-a2b3-fde55be03bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:12.083359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd78b9-23ce-4914-a2b3-fde55be03bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:12.083636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd78b9-23ce-4914-a2b3-fde55be03bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:12.083907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd78b9-23ce-4914-a2b3-fde55be03bc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:12.084665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd78b9-23ce-4914-a2b3-fde55be03bc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:12.084966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd78b9-23ce-4914-a2b3-fde55be03bc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:12.086394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd78b9-23ce-4914-a2b3-fde55be03bc5 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:12.094481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 550/1090] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:51:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:12.100209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd78b9-23ce-4914-a2b3-fde55be03bc5 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:12.160835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04dc42-14ae-4c10-a6c2-637af814783e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:12.161713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:12.198413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592b759-ce3d-444b-9560-0b6e323ff5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:12.199394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592b759-ce3d-444b-9560-0b6e323ff5af None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:12.199836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592b759-ce3d-444b-9560-0b6e323ff5af None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:12.200265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592b759-ce3d-444b-9560-0b6e323ff5af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:12.203307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd78b9-23ce-4914-a2b3-fde55be03bc5 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:12.210782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592b759-ce3d-444b-9560-0b6e323ff5af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3592b759-ce3d-444b-9560-0b6e323ff5af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:12.220260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:12.221421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:12.222267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 541/1091] 10.222.0.85 () {56 vars in 1120 bytes} [Wed Jul 20 21:51:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:12.228249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592b759-ce3d-444b-9560-0b6e323ff5af None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:12.241436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e8035-5404-4151-a39d-5d2ff46fa985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:12.242342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e8035-5404-4151-a39d-5d2ff46fa985 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:12.242630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e8035-5404-4151-a39d-5d2ff46fa985 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:12.242904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e8035-5404-4151-a39d-5d2ff46fa985 None admin] PATH_INFO: `/v3/users/6f4cceed3e7a4f6ea8f642554e1393df` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:12.244212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e8035-5404-4151-a39d-5d2ff46fa985 None admin] RBAC: Authorizing `identity:get_user(user_id=6f4cceed3e7a4f6ea8f642554e1393df)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:12.245642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e8035-5404-4151-a39d-5d2ff46fa985 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:12.247281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 551/1092] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:12 2022] GET /identity/v3/users/6f4cceed3e7a4f6ea8f642554e1393df => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:12.253142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e8035-5404-4151-a39d-5d2ff46fa985 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:12.294037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:12.331477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592b759-ce3d-444b-9560-0b6e323ff5af None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:12.354110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e8035-5404-4151-a39d-5d2ff46fa985 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:12.366389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be137bd-8b46-4142-987b-3bcb61b92e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:12.367059 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be137bd-8b46-4142-987b-3bcb61b92e72 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:12.367370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be137bd-8b46-4142-987b-3bcb61b92e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:12.367644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be137bd-8b46-4142-987b-3bcb61b92e72 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:12.368425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be137bd-8b46-4142-987b-3bcb61b92e72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:12.368732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be137bd-8b46-4142-987b-3bcb61b92e72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:12.370146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be137bd-8b46-4142-987b-3bcb61b92e72 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:12.378806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 542/1093] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Jul 20 21:51:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:12.379392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:12.384484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be137bd-8b46-4142-987b-3bcb61b92e72 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:12.387282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82aa5b-ffc8-401b-96d7-96c093ca4807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:12.387934 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82aa5b-ffc8-401b-96d7-96c093ca4807 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:12.388228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82aa5b-ffc8-401b-96d7-96c093ca4807 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:12.393271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82aa5b-ffc8-401b-96d7-96c093ca4807 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:12.458186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82aa5b-ffc8-401b-96d7-96c093ca4807 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:12.459557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a82aa5b-ffc8-401b-96d7-96c093ca4807 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:12.485197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be137bd-8b46-4142-987b-3bcb61b92e72 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:12.507469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:12.518621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d51bc-3797-4028-8733-4b9eb70ed66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:12.524317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d51bc-3797-4028-8733-4b9eb70ed66e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:12.524317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d51bc-3797-4028-8733-4b9eb70ed66e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:12.524317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79d51bc-3797-4028-8733-4b9eb70ed66e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:12.531012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d51bc-3797-4028-8733-4b9eb70ed66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:12.532490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79d51bc-3797-4028-8733-4b9eb70ed66e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e79d51bc-3797-4028-8733-4b9eb70ed66e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:51:12.550598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:12.551725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:12.552960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:51:12.552960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:51:12.552960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:12.552960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:12.552960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 543/1094] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:12.557567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d51bc-3797-4028-8733-4b9eb70ed66e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:12.565974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 552/1095] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:12.572449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82aa5b-ffc8-401b-96d7-96c093ca4807 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:12.599538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:12.658480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79d51bc-3797-4028-8733-4b9eb70ed66e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:12.672496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82aa5b-ffc8-401b-96d7-96c093ca4807 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:12.691365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db678c4-90a6-40b8-ae45-8acf0172f9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:12.692051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db678c4-90a6-40b8-ae45-8acf0172f9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:12.692325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db678c4-90a6-40b8-ae45-8acf0172f9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:12.692593 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db678c4-90a6-40b8-ae45-8acf0172f9e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:12.693327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db678c4-90a6-40b8-ae45-8acf0172f9e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:12.693627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db678c4-90a6-40b8-ae45-8acf0172f9e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:12.694987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db678c4-90a6-40b8-ae45-8acf0172f9e5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:12.706246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184effd8-5a09-4984-ae81-a91f78e8395a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:12.707071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 544/1096] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:12.707199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184effd8-5a09-4984-ae81-a91f78e8395a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:12.707361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184effd8-5a09-4984-ae81-a91f78e8395a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:12.707636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184effd8-5a09-4984-ae81-a91f78e8395a None admin] PATH_INFO: `/v3/projects/d957b9cb133b477e97b5f96d8703e21f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:12.708937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184effd8-5a09-4984-ae81-a91f78e8395a None admin] RBAC: Authorizing `identity:get_project(project_id=d957b9cb133b477e97b5f96d8703e21f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:12.710313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184effd8-5a09-4984-ae81-a91f78e8395a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:12.712905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 553/1097] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:12 2022] GET /identity/v3/projects/d957b9cb133b477e97b5f96d8703e21f => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:12.713389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db678c4-90a6-40b8-ae45-8acf0172f9e5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:12.718699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184effd8-5a09-4984-ae81-a91f78e8395a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:12.747497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:12.811624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:12.816772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db678c4-90a6-40b8-ae45-8acf0172f9e5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:12.817686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184effd8-5a09-4984-ae81-a91f78e8395a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:12.851163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c162c-87c4-417e-b248-33c7611c0da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:12.851970 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c162c-87c4-417e-b248-33c7611c0da7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:12.852194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d137c6-fd4b-4961-96fd-bd152bfee7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:12.852316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c162c-87c4-417e-b248-33c7611c0da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:12.852551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c162c-87c4-417e-b248-33c7611c0da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:12.852954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d137c6-fd4b-4961-96fd-bd152bfee7ae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:12.853241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d137c6-fd4b-4961-96fd-bd152bfee7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:12.853378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c162c-87c4-417e-b248-33c7611c0da7 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=d957b9cb133b477e97b5f96d8703e21f, user.id=6f4cceed3e7a4f6ea8f642554e1393df) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:12.853519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d137c6-fd4b-4961-96fd-bd152bfee7ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:12.853689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c162c-87c4-417e-b248-33c7611c0da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:12.855151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c162c-87c4-417e-b248-33c7611c0da7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:12.861100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d137c6-fd4b-4961-96fd-bd152bfee7ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:12.861892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 554/1098] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:51:12 2022] GET /identity/v3/role_assignments?user.id=6f4cceed3e7a4f6ea8f642554e1393df&scope.project.id=d957b9cb133b477e97b5f96d8703e21f&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:12.862550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d137c6-fd4b-4961-96fd-bd152bfee7ae None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c3d137c6-fd4b-4961-96fd-bd152bfee7ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:51:12.878094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:12.879135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:12.880153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 545/1099] 10.222.0.85 () {56 vars in 1093 bytes} [Wed Jul 20 21:51:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:12.886324 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c162c-87c4-417e-b248-33c7611c0da7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:12.996162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c162c-87c4-417e-b248-33c7611c0da7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:13.033389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227cd4b-bd0a-4476-8d33-dbf280846764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:13.034055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227cd4b-bd0a-4476-8d33-dbf280846764 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:13.034331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227cd4b-bd0a-4476-8d33-dbf280846764 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:13.034601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e227cd4b-bd0a-4476-8d33-dbf280846764 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:13.035441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227cd4b-bd0a-4476-8d33-dbf280846764 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:13.035749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227cd4b-bd0a-4476-8d33-dbf280846764 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:13.037211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e227cd4b-bd0a-4476-8d33-dbf280846764 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:13.055331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 555/1100] 10.222.0.85 () {56 vars in 1133 bytes} [Wed Jul 20 21:51:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:13.061861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d137c6-fd4b-4961-96fd-bd152bfee7ae None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:13.158918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:13.165501 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d137c6-fd4b-4961-96fd-bd152bfee7ae None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:13.201536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50138366-2c82-4400-aadf-329d666a1735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:13.202189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50138366-2c82-4400-aadf-329d666a1735 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:13.202474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50138366-2c82-4400-aadf-329d666a1735 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:13.202751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50138366-2c82-4400-aadf-329d666a1735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:13.270688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50138366-2c82-4400-aadf-329d666a1735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:13.272091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50138366-2c82-4400-aadf-329d666a1735 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:13.364175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:13.371732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 546/1101] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:13.377549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227cd4b-bd0a-4476-8d33-dbf280846764 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:13.396898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:13.475671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e227cd4b-bd0a-4476-8d33-dbf280846764 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:13.510262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b107119-9f3d-4725-a7bc-894a199b0008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:13.511092 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b107119-9f3d-4725-a7bc-894a199b0008 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:13.511371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b107119-9f3d-4725-a7bc-894a199b0008 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:13.511641 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b107119-9f3d-4725-a7bc-894a199b0008 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:13.522286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b107119-9f3d-4725-a7bc-894a199b0008 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:13.523717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b107119-9f3d-4725-a7bc-894a199b0008 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-3b107119-9f3d-4725-a7bc-894a199b0008 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:51:13.542402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:13.543500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:13.544881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:51:13.544881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:51:13.544881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:51:13.544881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:13.544881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 556/1102] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:13.549437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50138366-2c82-4400-aadf-329d666a1735 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:13.651884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50138366-2c82-4400-aadf-329d666a1735 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:13.685241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255743a-61f0-44f7-810b-5cbe27528725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:13.685892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255743a-61f0-44f7-810b-5cbe27528725 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:13.686171 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255743a-61f0-44f7-810b-5cbe27528725 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:13.686439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8255743a-61f0-44f7-810b-5cbe27528725 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:13.687146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255743a-61f0-44f7-810b-5cbe27528725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:13.687446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255743a-61f0-44f7-810b-5cbe27528725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:13.688826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8255743a-61f0-44f7-810b-5cbe27528725 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:13.700362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 547/1103] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:13.705959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b107119-9f3d-4725-a7bc-894a199b0008 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:13.776198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:13.804970 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b107119-9f3d-4725-a7bc-894a199b0008 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:13.838143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d6ea6-eae0-4d3a-9d3f-6445609b1e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:13.838917 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d6ea6-eae0-4d3a-9d3f-6445609b1e91 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:13.839194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d6ea6-eae0-4d3a-9d3f-6445609b1e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:13.839462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d6ea6-eae0-4d3a-9d3f-6445609b1e91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:13.845838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d6ea6-eae0-4d3a-9d3f-6445609b1e91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:13.847336 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d6ea6-eae0-4d3a-9d3f-6445609b1e91 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-741d6ea6-eae0-4d3a-9d3f-6445609b1e91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:51:13.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:13.862246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:13.868708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:51:13.868708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:51:13.868708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:51:13.868708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:51:13.868708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:51:13.868708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:51:13.868708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:51:13.868708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:13.868708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 557/1104] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:51:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:13.869229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255743a-61f0-44f7-810b-5cbe27528725 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:13.924089 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:13.967010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8255743a-61f0-44f7-810b-5cbe27528725 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:14.001578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685f81d-2ab2-43ef-9767-9f2342c27bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:14.002240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f81d-2ab2-43ef-9767-9f2342c27bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:14.002523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f81d-2ab2-43ef-9767-9f2342c27bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:14.002799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685f81d-2ab2-43ef-9767-9f2342c27bb3 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:14.003580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685f81d-2ab2-43ef-9767-9f2342c27bb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:14.003888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685f81d-2ab2-43ef-9767-9f2342c27bb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:14.005372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685f81d-2ab2-43ef-9767-9f2342c27bb3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:14.018229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 548/1105] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:51:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:14.025567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d6ea6-eae0-4d3a-9d3f-6445609b1e91 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:14.125917 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d6ea6-eae0-4d3a-9d3f-6445609b1e91 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:14.154799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:14.160603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8a9625-d571-499f-91f3-835e192485a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:14.161253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a9625-d571-499f-91f3-835e192485a6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:14.161537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a9625-d571-499f-91f3-835e192485a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:14.161817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8a9625-d571-499f-91f3-835e192485a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:14.162640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a9625-d571-499f-91f3-835e192485a6 None admin] RBAC: Adding query filter params (role.id=261be7f206d549628e13bb85aeae222a, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=5e192a50b09b49b4b7db2508ecf75af5) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:14.162952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a9625-d571-499f-91f3-835e192485a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:14.164644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8a9625-d571-499f-91f3-835e192485a6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:14.170732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 558/1106] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:51:14 2022] GET /identity/v3/role_assignments?user.id=5e192a50b09b49b4b7db2508ecf75af5&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=261be7f206d549628e13bb85aeae222a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:14.943531 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7660cca-7a98-4191-8745-10358036329f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:14.944111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7660cca-7a98-4191-8745-10358036329f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:14.944192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7660cca-7a98-4191-8745-10358036329f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:14.946593 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 549/1107] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:14.952381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08804ae-6791-4017-90d3-7148768ed82c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:14.952784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08804ae-6791-4017-90d3-7148768ed82c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:14.952942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08804ae-6791-4017-90d3-7148768ed82c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:14.971623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f08804ae-6791-4017-90d3-7148768ed82c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:14.972837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f08804ae-6791-4017-90d3-7148768ed82c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:15.040961 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 559/1108] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:15.065751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7660cca-7a98-4191-8745-10358036329f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:15.164767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7660cca-7a98-4191-8745-10358036329f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:15.180644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:15.198411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e54711-e420-4012-b706-09672da581da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:15.199129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e54711-e420-4012-b706-09672da581da None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:15.199410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e54711-e420-4012-b706-09672da581da None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:15.199681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e54711-e420-4012-b706-09672da581da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:15.200857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e54711-e420-4012-b706-09672da581da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:15.202380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e54711-e420-4012-b706-09672da581da None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:15.203991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 550/1109] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:15.210704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08804ae-6791-4017-90d3-7148768ed82c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:15.310372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08804ae-6791-4017-90d3-7148768ed82c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:15.333861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:15.344684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909b84cb-fcf9-45c1-ab97-52e88ea3105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:15.348975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b84cb-fcf9-45c1-ab97-52e88ea3105f None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:15.348975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b84cb-fcf9-45c1-ab97-52e88ea3105f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:15.348975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909b84cb-fcf9-45c1-ab97-52e88ea3105f None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:15.348975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b84cb-fcf9-45c1-ab97-52e88ea3105f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:15.348975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909b84cb-fcf9-45c1-ab97-52e88ea3105f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:15.437234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 560/1110] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:51:15 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 21:51:17.533472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a09ef-e459-401c-992a-8770ad843854 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:17.534022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a09ef-e459-401c-992a-8770ad843854 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:17.534022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a09ef-e459-401c-992a-8770ad843854 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:17.535437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 551/1111] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:17.540814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2689fe-262f-46e2-b0b1-cf72b9d42df5 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:17.541212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2689fe-262f-46e2-b0b1-cf72b9d42df5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:17.541362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2689fe-262f-46e2-b0b1-cf72b9d42df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:17.558005 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6f2689fe-262f-46e2-b0b1-cf72b9d42df5 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:17.559166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6f2689fe-262f-46e2-b0b1-cf72b9d42df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:17.623105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 561/1112] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:51:17.647532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a09ef-e459-401c-992a-8770ad843854 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:17.747718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a09ef-e459-401c-992a-8770ad843854 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:17.782258 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9bf1c-9d7f-46ce-87d5-4bb40abace52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:17.783166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9bf1c-9d7f-46ce-87d5-4bb40abace52 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:17.783529 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9bf1c-9d7f-46ce-87d5-4bb40abace52 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:17.783755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9bf1c-9d7f-46ce-87d5-4bb40abace52 None admin] PATH_INFO: `/v3/roles/5b16ed690a6942c288df268569b6ab85` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:17.785251 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9bf1c-9d7f-46ce-87d5-4bb40abace52 None admin] RBAC: Authorizing `identity:get_role(role_id=5b16ed690a6942c288df268569b6ab85)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:17.786631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9bf1c-9d7f-46ce-87d5-4bb40abace52 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:17.788144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 552/1113] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:17 2022] GET /identity/v3/roles/5b16ed690a6942c288df268569b6ab85 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:17.794857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2689fe-262f-46e2-b0b1-cf72b9d42df5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:17.894693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2689fe-262f-46e2-b0b1-cf72b9d42df5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:17.905264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:17.928628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de21f2-b0ae-4f0a-ae42-0db202b6546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:17.930179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de21f2-b0ae-4f0a-ae42-0db202b6546a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:17.930469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de21f2-b0ae-4f0a-ae42-0db202b6546a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:17.930761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de21f2-b0ae-4f0a-ae42-0db202b6546a None admin] PATH_INFO: `/v3/users/0835cfa54a5b4646ac8fab4e9cc9eef0` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:17.944277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de21f2-b0ae-4f0a-ae42-0db202b6546a None admin] RBAC: Authorizing `identity:get_user(user_id=0835cfa54a5b4646ac8fab4e9cc9eef0)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:17.945874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de21f2-b0ae-4f0a-ae42-0db202b6546a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:17.948085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 562/1114] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:17 2022] GET /identity/v3/users/0835cfa54a5b4646ac8fab4e9cc9eef0 => generated 286 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:17.953352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9bf1c-9d7f-46ce-87d5-4bb40abace52 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:18.007822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:18.055607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9bf1c-9d7f-46ce-87d5-4bb40abace52 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:18.089099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e8eb5-f295-4848-8962-447e3dd9cd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:18.089774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8eb5-f295-4848-8962-447e3dd9cd31 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:18.090058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8eb5-f295-4848-8962-447e3dd9cd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:18.090332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2e8eb5-f295-4848-8962-447e3dd9cd31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:18.157713 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e8eb5-f295-4848-8962-447e3dd9cd31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:18.159150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2e8eb5-f295-4848-8962-447e3dd9cd31 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:18.207909 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:18.257953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 553/1115] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:18.264058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de21f2-b0ae-4f0a-ae42-0db202b6546a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:18.362524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de21f2-b0ae-4f0a-ae42-0db202b6546a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:18.395722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b3a4b9-69be-4498-b852-e54bffe3c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:18.396607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a4b9-69be-4498-b852-e54bffe3c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:18.396892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a4b9-69be-4498-b852-e54bffe3c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:18.397168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b3a4b9-69be-4498-b852-e54bffe3c6d6 None admin] PATH_INFO: `/v3/projects/d957b9cb133b477e97b5f96d8703e21f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:18.398846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3a4b9-69be-4498-b852-e54bffe3c6d6 None admin] RBAC: Authorizing `identity:get_project(project_id=d957b9cb133b477e97b5f96d8703e21f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:18.400642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b3a4b9-69be-4498-b852-e54bffe3c6d6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:18.402335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 563/1116] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:18 2022] GET /identity/v3/projects/d957b9cb133b477e97b5f96d8703e21f => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:18.408556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e8eb5-f295-4848-8962-447e3dd9cd31 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:18.506741 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2e8eb5-f295-4848-8962-447e3dd9cd31 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:18.541614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed897d66-afe2-4090-968a-2f11b3d77ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:18.542244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed897d66-afe2-4090-968a-2f11b3d77ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:18.542531 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed897d66-afe2-4090-968a-2f11b3d77ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:18.542807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed897d66-afe2-4090-968a-2f11b3d77ad6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:18.543645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed897d66-afe2-4090-968a-2f11b3d77ad6 None admin] RBAC: Adding query filter params (role.id=5b16ed690a6942c288df268569b6ab85, scope.project.id=d957b9cb133b477e97b5f96d8703e21f, user.id=0835cfa54a5b4646ac8fab4e9cc9eef0) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:18.543972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed897d66-afe2-4090-968a-2f11b3d77ad6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:18.545409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed897d66-afe2-4090-968a-2f11b3d77ad6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:18.550711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 554/1117] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:51:18 2022] GET /identity/v3/role_assignments?user.id=0835cfa54a5b4646ac8fab4e9cc9eef0&scope.project.id=d957b9cb133b477e97b5f96d8703e21f&role.id=5b16ed690a6942c288df268569b6ab85 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:20.551343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512096b3-a58f-4cf9-b20b-35dffa9d385e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:20.551870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512096b3-a58f-4cf9-b20b-35dffa9d385e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:20.552020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512096b3-a58f-4cf9-b20b-35dffa9d385e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:20.553381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 564/1118] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:20.558980 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9da57-27ea-4e24-bc1f-dc2b069e5981 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:20.559415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9da57-27ea-4e24-bc1f-dc2b069e5981 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:20.559534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9da57-27ea-4e24-bc1f-dc2b069e5981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:20.576157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-afc9da57-27ea-4e24-bc1f-dc2b069e5981 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:20.577334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-afc9da57-27ea-4e24-bc1f-dc2b069e5981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:20.588335 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:20.642761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 555/1119] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:51:20.666055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512096b3-a58f-4cf9-b20b-35dffa9d385e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:20.701227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:20.766859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512096b3-a58f-4cf9-b20b-35dffa9d385e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:20.801954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43fe59-b830-46b5-bffa-4f35d8c9bf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:20.802731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43fe59-b830-46b5-bffa-4f35d8c9bf79 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:20.803011 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43fe59-b830-46b5-bffa-4f35d8c9bf79 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:20.803284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43fe59-b830-46b5-bffa-4f35d8c9bf79 None admin] PATH_INFO: `/v3/roles/5b16ed690a6942c288df268569b6ab85` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:20.804931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43fe59-b830-46b5-bffa-4f35d8c9bf79 None admin] RBAC: Authorizing `identity:get_role(role_id=5b16ed690a6942c288df268569b6ab85)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:20.806310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be43fe59-b830-46b5-bffa-4f35d8c9bf79 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:20.807686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 565/1120] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:20 2022] GET /identity/v3/roles/5b16ed690a6942c288df268569b6ab85 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:20.813604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9da57-27ea-4e24-bc1f-dc2b069e5981 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:20.913220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9da57-27ea-4e24-bc1f-dc2b069e5981 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:20.948173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fda6cb-ed23-4ef0-aea2-ded2436b5bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:20.949050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fda6cb-ed23-4ef0-aea2-ded2436b5bde None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:20.949332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fda6cb-ed23-4ef0-aea2-ded2436b5bde None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:20.949610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fda6cb-ed23-4ef0-aea2-ded2436b5bde None admin] PATH_INFO: `/v3/users/0835cfa54a5b4646ac8fab4e9cc9eef0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:20.950786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fda6cb-ed23-4ef0-aea2-ded2436b5bde None admin] RBAC: Authorizing `identity:get_user(user_id=0835cfa54a5b4646ac8fab4e9cc9eef0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:20.952266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fda6cb-ed23-4ef0-aea2-ded2436b5bde None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:20.954093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 556/1121] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:20 2022] GET /identity/v3/users/0835cfa54a5b4646ac8fab4e9cc9eef0 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:20.960032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43fe59-b830-46b5-bffa-4f35d8c9bf79 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:21.058732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be43fe59-b830-46b5-bffa-4f35d8c9bf79 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:21.060901 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:21.092340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0675b-0aa3-4c6f-9f3b-48e0a455d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:21.093399 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0675b-0aa3-4c6f-9f3b-48e0a455d54f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:21.094099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0675b-0aa3-4c6f-9f3b-48e0a455d54f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:21.094454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0675b-0aa3-4c6f-9f3b-48e0a455d54f None admin] PATH_INFO: `/v3/projects/d957b9cb133b477e97b5f96d8703e21f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:21.095972 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0675b-0aa3-4c6f-9f3b-48e0a455d54f None admin] RBAC: Authorizing `identity:get_project(project_id=d957b9cb133b477e97b5f96d8703e21f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:21.097403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e0675b-0aa3-4c6f-9f3b-48e0a455d54f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:21.099097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 566/1122] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:20 2022] GET /identity/v3/projects/d957b9cb133b477e97b5f96d8703e21f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:21.105316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fda6cb-ed23-4ef0-aea2-ded2436b5bde None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:21.120859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:21.203077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fda6cb-ed23-4ef0-aea2-ded2436b5bde None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:21.236539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76e354-91ac-40d8-8b0f-d808f9d18f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:21.237585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e354-91ac-40d8-8b0f-d808f9d18f4a None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:21.237871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e354-91ac-40d8-8b0f-d808f9d18f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:21.238146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76e354-91ac-40d8-8b0f-d808f9d18f4a None admin] PATH_INFO: `/v3/projects/d957b9cb133b477e97b5f96d8703e21f/users/0835cfa54a5b4646ac8fab4e9cc9eef0/roles/5b16ed690a6942c288df268569b6ab85` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:21.240351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76e354-91ac-40d8-8b0f-d808f9d18f4a None admin] RBAC: Authorizing `identity:create_grant(project_id=d957b9cb133b477e97b5f96d8703e21f, user_id=0835cfa54a5b4646ac8fab4e9cc9eef0, role_id=5b16ed690a6942c288df268569b6ab85)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:21.241788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76e354-91ac-40d8-8b0f-d808f9d18f4a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:21.344582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 557/1123] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:51:21 2022] PUT /identity/v3/projects/d957b9cb133b477e97b5f96d8703e21f/users/0835cfa54a5b4646ac8fab4e9cc9eef0/roles/5b16ed690a6942c288df268569b6ab85 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:51:23.347827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c16a89-d4ba-4c2e-8c1b-998d7c5350a1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:23.348374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c16a89-d4ba-4c2e-8c1b-998d7c5350a1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:23.348470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c16a89-d4ba-4c2e-8c1b-998d7c5350a1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:23.349781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 567/1124] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:23.355548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79000987-da8d-45c4-8da4-ee41cb0b8869 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:23.356006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79000987-da8d-45c4-8da4-ee41cb0b8869 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:23.356116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79000987-da8d-45c4-8da4-ee41cb0b8869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:23.372401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-79000987-da8d-45c4-8da4-ee41cb0b8869 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:23.373578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-79000987-da8d-45c4-8da4-ee41cb0b8869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:23.438675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 558/1125] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 20 21:51:23.463006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c16a89-d4ba-4c2e-8c1b-998d7c5350a1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:23.562127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c16a89-d4ba-4c2e-8c1b-998d7c5350a1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:23.595104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c5b7d-871c-4d1d-99c4-5668c5a8725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:23.595957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c5b7d-871c-4d1d-99c4-5668c5a8725d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:23.596246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c5b7d-871c-4d1d-99c4-5668c5a8725d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:23.596524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626c5b7d-871c-4d1d-99c4-5668c5a8725d None admin] PATH_INFO: `/v3/roles/5b16ed690a6942c288df268569b6ab85` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:23.598047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c5b7d-871c-4d1d-99c4-5668c5a8725d None admin] RBAC: Authorizing `identity:get_role(role_id=5b16ed690a6942c288df268569b6ab85)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:23.599363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626c5b7d-871c-4d1d-99c4-5668c5a8725d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:23.600758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 568/1126] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:23 2022] GET /identity/v3/roles/5b16ed690a6942c288df268569b6ab85 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:23.607313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79000987-da8d-45c4-8da4-ee41cb0b8869 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:23.610433 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:23.704239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79000987-da8d-45c4-8da4-ee41cb0b8869 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:23.737762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeddfa9-530e-450f-bd58-8af0a3c6e50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:23.738623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeddfa9-530e-450f-bd58-8af0a3c6e50d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:23.738906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeddfa9-530e-450f-bd58-8af0a3c6e50d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:23.739178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeddfa9-530e-450f-bd58-8af0a3c6e50d None admin] PATH_INFO: `/v3/users/0835cfa54a5b4646ac8fab4e9cc9eef0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:23.740376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeddfa9-530e-450f-bd58-8af0a3c6e50d None admin] RBAC: Authorizing `identity:get_user(user_id=0835cfa54a5b4646ac8fab4e9cc9eef0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:23.741855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeddfa9-530e-450f-bd58-8af0a3c6e50d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:23.743770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 559/1127] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:23 2022] GET /identity/v3/users/0835cfa54a5b4646ac8fab4e9cc9eef0 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:23.749558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c5b7d-871c-4d1d-99c4-5668c5a8725d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:23.791447 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:23.846466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626c5b7d-871c-4d1d-99c4-5668c5a8725d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:23.878378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c4c26-b513-41fe-a6cc-46e379f20117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:23.878945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4c26-b513-41fe-a6cc-46e379f20117 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:23.879222 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4c26-b513-41fe-a6cc-46e379f20117 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:23.879493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674c4c26-b513-41fe-a6cc-46e379f20117 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:23.945754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c4c26-b513-41fe-a6cc-46e379f20117 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:23.947194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674c4c26-b513-41fe-a6cc-46e379f20117 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:23.985964 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:24.041877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 569/1128] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:24.047803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeddfa9-530e-450f-bd58-8af0a3c6e50d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:24.115938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:24.145853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeddfa9-530e-450f-bd58-8af0a3c6e50d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:24.180035 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2b499-a2da-40f8-8b5d-39387a510552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:24.180877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2b499-a2da-40f8-8b5d-39387a510552 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:24.181152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2b499-a2da-40f8-8b5d-39387a510552 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:24.181421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2b499-a2da-40f8-8b5d-39387a510552 None admin] PATH_INFO: `/v3/projects/d957b9cb133b477e97b5f96d8703e21f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:24.182576 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2b499-a2da-40f8-8b5d-39387a510552 None admin] RBAC: Authorizing `identity:get_project(project_id=d957b9cb133b477e97b5f96d8703e21f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:24.184016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2b499-a2da-40f8-8b5d-39387a510552 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:24.185684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 560/1129] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:24 2022] GET /identity/v3/projects/d957b9cb133b477e97b5f96d8703e21f => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:24.191820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c4c26-b513-41fe-a6cc-46e379f20117 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:24.288526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674c4c26-b513-41fe-a6cc-46e379f20117 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:24.322022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9c263d-a664-422b-a0b6-de57b266bbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:24.322647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c263d-a664-422b-a0b6-de57b266bbe7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:24.322924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c263d-a664-422b-a0b6-de57b266bbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:24.323195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9c263d-a664-422b-a0b6-de57b266bbe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:24.324035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c263d-a664-422b-a0b6-de57b266bbe7 None admin] RBAC: Adding query filter params (role.id=5b16ed690a6942c288df268569b6ab85, scope.project.id=d957b9cb133b477e97b5f96d8703e21f, user.id=0835cfa54a5b4646ac8fab4e9cc9eef0) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:24.324341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c263d-a664-422b-a0b6-de57b266bbe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:24.325754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9c263d-a664-422b-a0b6-de57b266bbe7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:24.331557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 570/1130] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:51:24 2022] GET /identity/v3/role_assignments?user.id=0835cfa54a5b4646ac8fab4e9cc9eef0&scope.project.id=d957b9cb133b477e97b5f96d8703e21f&role.id=5b16ed690a6942c288df268569b6ab85 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:26.390398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519dc88-a3ba-4312-b5e7-861ef793ee22 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:26.391191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519dc88-a3ba-4312-b5e7-861ef793ee22 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:26.391191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a519dc88-a3ba-4312-b5e7-861ef793ee22 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:26.392609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 561/1131] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:26.397701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2ff22-6ea7-486f-9b97-73271e696f04 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:26.398717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2ff22-6ea7-486f-9b97-73271e696f04 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:26.398810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2ff22-6ea7-486f-9b97-73271e696f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:26.404699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:26.416644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c2e2ff22-6ea7-486f-9b97-73271e696f04 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:26.417813 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c2e2ff22-6ea7-486f-9b97-73271e696f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:26.483999 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 571/1132] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:26.507525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519dc88-a3ba-4312-b5e7-861ef793ee22 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:26.608644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a519dc88-a3ba-4312-b5e7-861ef793ee22 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:26.641210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d8889-cbc5-401e-9bc1-6cec8728f058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:26.641920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d8889-cbc5-401e-9bc1-6cec8728f058 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:26.642202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d8889-cbc5-401e-9bc1-6cec8728f058 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:26.642476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d8889-cbc5-401e-9bc1-6cec8728f058 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:26.643648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d8889-cbc5-401e-9bc1-6cec8728f058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:26.645111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d8889-cbc5-401e-9bc1-6cec8728f058 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:26.646721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 562/1133] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:26.653214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2ff22-6ea7-486f-9b97-73271e696f04 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:26.749566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2ff22-6ea7-486f-9b97-73271e696f04 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:26.782602 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80445a-8104-4f08-923b-e340a8bfd4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:26.783246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80445a-8104-4f08-923b-e340a8bfd4d9 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:26.783525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80445a-8104-4f08-923b-e340a8bfd4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:26.783797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80445a-8104-4f08-923b-e340a8bfd4d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:26.784523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80445a-8104-4f08-923b-e340a8bfd4d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:26.785934 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80445a-8104-4f08-923b-e340a8bfd4d9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:26.789797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:26.889706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 572/1134] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:51:26 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:51:28.971111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f297081-52bd-4b87-9002-37823560d28e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:28.971571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f297081-52bd-4b87-9002-37823560d28e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:28.971662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f297081-52bd-4b87-9002-37823560d28e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:28.973115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 563/1135] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:28.978653 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ba30f-d392-47ab-bb34-050be808a487 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:28.979088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ba30f-d392-47ab-bb34-050be808a487 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:28.979209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ba30f-d392-47ab-bb34-050be808a487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:28.996223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-691ba30f-d392-47ab-bb34-050be808a487 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:28.997425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-691ba30f-d392-47ab-bb34-050be808a487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:29.063196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 573/1136] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:29.088299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f297081-52bd-4b87-9002-37823560d28e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:29.099669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:29.191060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f297081-52bd-4b87-9002-37823560d28e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:29.224189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace632af-a3e3-4c4a-9039-d45050b8d1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:29.224985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace632af-a3e3-4c4a-9039-d45050b8d1fb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:29.225283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace632af-a3e3-4c4a-9039-d45050b8d1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:29.225586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace632af-a3e3-4c4a-9039-d45050b8d1fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:29.227307 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace632af-a3e3-4c4a-9039-d45050b8d1fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:29.228762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace632af-a3e3-4c4a-9039-d45050b8d1fb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:29.230385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 564/1137] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:51:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:29.236355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ba30f-d392-47ab-bb34-050be808a487 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:29.334371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ba30f-d392-47ab-bb34-050be808a487 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:29.350046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:29.368209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39664bb5-943a-4d91-8ce1-96afecb9c344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:29.368900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39664bb5-943a-4d91-8ce1-96afecb9c344 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:29.369188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39664bb5-943a-4d91-8ce1-96afecb9c344 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:29.369465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39664bb5-943a-4d91-8ce1-96afecb9c344 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:29.370183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39664bb5-943a-4d91-8ce1-96afecb9c344 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:29.371642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39664bb5-943a-4d91-8ce1-96afecb9c344 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:29.464009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 574/1138] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:51:29 2022] POST /identity/v3/users => generated 286 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 21:51:31.542076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13e50-9978-4b33-b55b-de68c0305095 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:31.542610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13e50-9978-4b33-b55b-de68c0305095 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:31.542610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd13e50-9978-4b33-b55b-de68c0305095 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:31.543987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 565/1139] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:31.549234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34932007-9a8d-40e4-9dae-14694406f07f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:31.549640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34932007-9a8d-40e4-9dae-14694406f07f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:31.549796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34932007-9a8d-40e4-9dae-14694406f07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:31.567050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-34932007-9a8d-40e4-9dae-14694406f07f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:31.568259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-34932007-9a8d-40e4-9dae-14694406f07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:31.634945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 575/1140] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:31.658610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd13e50-9978-4b33-b55b-de68c0305095 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:31.736284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:31.759732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd13e50-9978-4b33-b55b-de68c0305095 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:31.793446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec06a9-8bc8-43c9-b63b-f475ab04ff8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:31.794157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec06a9-8bc8-43c9-b63b-f475ab04ff8a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:31.794438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec06a9-8bc8-43c9-b63b-f475ab04ff8a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:31.794710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec06a9-8bc8-43c9-b63b-f475ab04ff8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:31.806046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec06a9-8bc8-43c9-b63b-f475ab04ff8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cdec06a9-8bc8-43c9-b63b-f475ab04ff8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:31.813540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:31.814626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:31.815807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 566/1141] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:51:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:31.820824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34932007-9a8d-40e4-9dae-14694406f07f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:31.917711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34932007-9a8d-40e4-9dae-14694406f07f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:31.919192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:31.952891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f22c0-25d4-454a-97b0-d3fab899a93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:31.953560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f22c0-25d4-454a-97b0-d3fab899a93b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:31.953840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f22c0-25d4-454a-97b0-d3fab899a93b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:31.954114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f22c0-25d4-454a-97b0-d3fab899a93b None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:31.954863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f22c0-25d4-454a-97b0-d3fab899a93b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:31.955169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f22c0-25d4-454a-97b0-d3fab899a93b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:31.957152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f22c0-25d4-454a-97b0-d3fab899a93b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:31.966101 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 576/1142] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:51:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:31.971793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec06a9-8bc8-43c9-b63b-f475ab04ff8a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:32.071328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec06a9-8bc8-43c9-b63b-f475ab04ff8a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:32.104852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620f7a6-428c-405b-b45c-b4b6175c0d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:32.105699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620f7a6-428c-405b-b45c-b4b6175c0d5e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:32.105981 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620f7a6-428c-405b-b45c-b4b6175c0d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:32.106255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0620f7a6-428c-405b-b45c-b4b6175c0d5e None admin] PATH_INFO: `/v3/users/8cdfaf4100794501a6a5208d7ea24720` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:32.108902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:32.119689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620f7a6-428c-405b-b45c-b4b6175c0d5e None admin] RBAC: Authorizing `identity:get_user(user_id=8cdfaf4100794501a6a5208d7ea24720)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:32.121173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0620f7a6-428c-405b-b45c-b4b6175c0d5e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:32.122811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 567/1143] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:31 2022] GET /identity/v3/users/8cdfaf4100794501a6a5208d7ea24720 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:32.128691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f22c0-25d4-454a-97b0-d3fab899a93b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:32.227305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f22c0-25d4-454a-97b0-d3fab899a93b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:32.259852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12429d-e9fe-4d5b-b6b4-1fa40a470d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:32.260509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12429d-e9fe-4d5b-b6b4-1fa40a470d89 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:32.260790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12429d-e9fe-4d5b-b6b4-1fa40a470d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:32.261062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12429d-e9fe-4d5b-b6b4-1fa40a470d89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:32.290577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:32.326789 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12429d-e9fe-4d5b-b6b4-1fa40a470d89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:32.328590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c12429d-e9fe-4d5b-b6b4-1fa40a470d89 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:32.435150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 577/1144] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:32.441111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620f7a6-428c-405b-b45c-b4b6175c0d5e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:32.546292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0620f7a6-428c-405b-b45c-b4b6175c0d5e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:32.582602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5211b-9198-4606-ae0c-e0138323f9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:32.583415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5211b-9198-4606-ae0c-e0138323f9da None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:32.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5211b-9198-4606-ae0c-e0138323f9da None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:32.584010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5211b-9198-4606-ae0c-e0138323f9da None admin] PATH_INFO: `/v3/projects/54996ce5552b4f828dd896d780833c36` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:32.585208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5211b-9198-4606-ae0c-e0138323f9da None admin] RBAC: Authorizing `identity:get_project(project_id=54996ce5552b4f828dd896d780833c36)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:32.586670 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5211b-9198-4606-ae0c-e0138323f9da None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:32.588505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 568/1145] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:32 2022] GET /identity/v3/projects/54996ce5552b4f828dd896d780833c36 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:32.594663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12429d-e9fe-4d5b-b6b4-1fa40a470d89 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:32.659012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:32.697818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12429d-e9fe-4d5b-b6b4-1fa40a470d89 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:32.731968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b52543-79d6-4aa4-8514-6f113248e4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:32.732615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b52543-79d6-4aa4-8514-6f113248e4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:32.732905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b52543-79d6-4aa4-8514-6f113248e4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:32.733183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b52543-79d6-4aa4-8514-6f113248e4a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:32.734008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b52543-79d6-4aa4-8514-6f113248e4a0 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=54996ce5552b4f828dd896d780833c36, user.id=8cdfaf4100794501a6a5208d7ea24720) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:32.734318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b52543-79d6-4aa4-8514-6f113248e4a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:32.735808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b52543-79d6-4aa4-8514-6f113248e4a0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:32.742636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 578/1146] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:51:32 2022] GET /identity/v3/role_assignments?user.id=8cdfaf4100794501a6a5208d7ea24720&scope.project.id=54996ce5552b4f828dd896d780833c36&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:34.780475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac21eb-96aa-4f7e-9d1c-8b03c6025247 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:34.781023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac21eb-96aa-4f7e-9d1c-8b03c6025247 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:34.781023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac21eb-96aa-4f7e-9d1c-8b03c6025247 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:34.782391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 569/1147] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:34.787633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2641b61-23b3-4afe-abdb-916830781a34 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:34.788105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2641b61-23b3-4afe-abdb-916830781a34 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:34.788255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2641b61-23b3-4afe-abdb-916830781a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:34.805219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b2641b61-23b3-4afe-abdb-916830781a34 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:34.806389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b2641b61-23b3-4afe-abdb-916830781a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:34.870601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 579/1148] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:34.894186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac21eb-96aa-4f7e-9d1c-8b03c6025247 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:34.956762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:34.996701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac21eb-96aa-4f7e-9d1c-8b03c6025247 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:35.030349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bbb61-c360-4d2e-8164-4283adbbe4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:35.031184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bbb61-c360-4d2e-8164-4283adbbe4ad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:35.031412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bbb61-c360-4d2e-8164-4283adbbe4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:35.031686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7bbb61-c360-4d2e-8164-4283adbbe4ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:35.042102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7bbb61-c360-4d2e-8164-4283adbbe4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fc7bbb61-c360-4d2e-8164-4283adbbe4ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:35.049742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:35.050903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:35.052110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 570/1149] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:51:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:35.057680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2641b61-23b3-4afe-abdb-916830781a34 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:35.114761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:35.156746 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2641b61-23b3-4afe-abdb-916830781a34 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:35.190624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d24b5b-3276-4560-b0c2-142169499cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:35.191282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d24b5b-3276-4560-b0c2-142169499cbf None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:35.191564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d24b5b-3276-4560-b0c2-142169499cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:35.191838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d24b5b-3276-4560-b0c2-142169499cbf None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:35.192614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d24b5b-3276-4560-b0c2-142169499cbf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:35.192918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d24b5b-3276-4560-b0c2-142169499cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:35.194277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d24b5b-3276-4560-b0c2-142169499cbf None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:35.202484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 580/1150] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:51:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:35.208394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bbb61-c360-4d2e-8164-4283adbbe4ad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:35.312147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7bbb61-c360-4d2e-8164-4283adbbe4ad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:35.333828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:35.345638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c14be0-094a-42a0-a6cc-656eb3ff2fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:35.352071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14be0-094a-42a0-a6cc-656eb3ff2fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:35.352071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14be0-094a-42a0-a6cc-656eb3ff2fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:35.352071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c14be0-094a-42a0-a6cc-656eb3ff2fb5 None admin] PATH_INFO: `/v3/users/8cdfaf4100794501a6a5208d7ea24720` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:35.352071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c14be0-094a-42a0-a6cc-656eb3ff2fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=8cdfaf4100794501a6a5208d7ea24720)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:35.352071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c14be0-094a-42a0-a6cc-656eb3ff2fb5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:35.352071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 571/1151] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:35 2022] GET /identity/v3/users/8cdfaf4100794501a6a5208d7ea24720 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:35.357962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d24b5b-3276-4560-b0c2-142169499cbf None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:35.456322 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d24b5b-3276-4560-b0c2-142169499cbf None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:35.475355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:35.489012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77510f79-775c-4a60-b54b-9997926bbb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:35.489862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77510f79-775c-4a60-b54b-9997926bbb2e None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:35.490142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77510f79-775c-4a60-b54b-9997926bbb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:35.490413 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77510f79-775c-4a60-b54b-9997926bbb2e None admin] PATH_INFO: `/v3/projects/54996ce5552b4f828dd896d780833c36` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:35.491602 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77510f79-775c-4a60-b54b-9997926bbb2e None admin] RBAC: Authorizing `identity:get_project(project_id=54996ce5552b4f828dd896d780833c36)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:35.493047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77510f79-775c-4a60-b54b-9997926bbb2e None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:35.494725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 581/1152] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:35 2022] GET /identity/v3/projects/54996ce5552b4f828dd896d780833c36 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:35.500884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c14be0-094a-42a0-a6cc-656eb3ff2fb5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:35.602234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c14be0-094a-42a0-a6cc-656eb3ff2fb5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:35.635371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c518ceb-543e-49fc-988b-1ddbdfa0d10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:35.636270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c518ceb-543e-49fc-988b-1ddbdfa0d10d None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:35.636555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c518ceb-543e-49fc-988b-1ddbdfa0d10d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:35.636829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c518ceb-543e-49fc-988b-1ddbdfa0d10d None admin] PATH_INFO: `/v3/projects/54996ce5552b4f828dd896d780833c36/users/8cdfaf4100794501a6a5208d7ea24720/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:35.638761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c518ceb-543e-49fc-988b-1ddbdfa0d10d None admin] RBAC: Authorizing `identity:create_grant(project_id=54996ce5552b4f828dd896d780833c36, user_id=8cdfaf4100794501a6a5208d7ea24720, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:35.640221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c518ceb-543e-49fc-988b-1ddbdfa0d10d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:35.726361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 572/1153] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:51:35 2022] PUT /identity/v3/projects/54996ce5552b4f828dd896d780833c36/users/8cdfaf4100794501a6a5208d7ea24720/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:51:37.770725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957159-a5da-489c-8196-43f912ad375a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:37.771276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957159-a5da-489c-8196-43f912ad375a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:37.771276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26957159-a5da-489c-8196-43f912ad375a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:37.772889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 582/1154] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:37.778453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0ecc1-9a1f-4c76-9a33-a5e5429daf7e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:37.778879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0ecc1-9a1f-4c76-9a33-a5e5429daf7e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:37.779006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0ecc1-9a1f-4c76-9a33-a5e5429daf7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:37.795800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ebf0ecc1-9a1f-4c76-9a33-a5e5429daf7e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:37.797013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ebf0ecc1-9a1f-4c76-9a33-a5e5429daf7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:37.841703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:37.861610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 573/1155] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:37.886517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26957159-a5da-489c-8196-43f912ad375a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:37.995435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26957159-a5da-489c-8196-43f912ad375a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:38.029025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e2893-5aae-4661-9e53-a16dbbc12f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:38.029738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e2893-5aae-4661-9e53-a16dbbc12f9a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:38.030021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e2893-5aae-4661-9e53-a16dbbc12f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:38.030296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1e2893-5aae-4661-9e53-a16dbbc12f9a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:38.041448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1e2893-5aae-4661-9e53-a16dbbc12f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-1c1e2893-5aae-4661-9e53-a16dbbc12f9a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:38.050103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:38.051215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:38.052368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 583/1156] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:51:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:38.058067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0ecc1-9a1f-4c76-9a33-a5e5429daf7e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:38.154950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0ecc1-9a1f-4c76-9a33-a5e5429daf7e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:38.188681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226a6ff-af21-4387-b1b5-557888c28426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:38.189335 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226a6ff-af21-4387-b1b5-557888c28426 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:38.189616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226a6ff-af21-4387-b1b5-557888c28426 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:38.189887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226a6ff-af21-4387-b1b5-557888c28426 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:38.190622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226a6ff-af21-4387-b1b5-557888c28426 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:38.190925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226a6ff-af21-4387-b1b5-557888c28426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:38.192332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a226a6ff-af21-4387-b1b5-557888c28426 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:38.200990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 574/1157] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:51:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:38.206796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e2893-5aae-4661-9e53-a16dbbc12f9a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:38.254705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:38.304147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1e2893-5aae-4661-9e53-a16dbbc12f9a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:38.337499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456b585-f971-4c80-b3f2-4dfb7003db19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:38.338344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456b585-f971-4c80-b3f2-4dfb7003db19 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:38.338622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456b585-f971-4c80-b3f2-4dfb7003db19 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:38.338891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456b585-f971-4c80-b3f2-4dfb7003db19 None admin] PATH_INFO: `/v3/users/8cdfaf4100794501a6a5208d7ea24720` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:38.340080 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456b585-f971-4c80-b3f2-4dfb7003db19 None admin] RBAC: Authorizing `identity:get_user(user_id=8cdfaf4100794501a6a5208d7ea24720)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:38.341488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456b585-f971-4c80-b3f2-4dfb7003db19 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:38.343100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 584/1158] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:38 2022] GET /identity/v3/users/8cdfaf4100794501a6a5208d7ea24720 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:38.349050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226a6ff-af21-4387-b1b5-557888c28426 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:38.391457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:38.448459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a226a6ff-af21-4387-b1b5-557888c28426 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:38.480788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4371997-d0f2-457a-a486-718e7940dc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:38.481426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4371997-d0f2-457a-a486-718e7940dc20 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:38.481705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4371997-d0f2-457a-a486-718e7940dc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:38.481977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4371997-d0f2-457a-a486-718e7940dc20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:38.547122 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4371997-d0f2-457a-a486-718e7940dc20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:38.548597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4371997-d0f2-457a-a486-718e7940dc20 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:38.589351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:38.645755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 575/1159] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:38.651783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456b585-f971-4c80-b3f2-4dfb7003db19 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:38.751536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456b585-f971-4c80-b3f2-4dfb7003db19 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:38.768022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:38.785102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbe4bae-1064-4aa7-9570-c29936a39c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:38.785952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe4bae-1064-4aa7-9570-c29936a39c2f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:38.786269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe4bae-1064-4aa7-9570-c29936a39c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:38.786545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbe4bae-1064-4aa7-9570-c29936a39c2f None admin] PATH_INFO: `/v3/projects/54996ce5552b4f828dd896d780833c36` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:38.787728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe4bae-1064-4aa7-9570-c29936a39c2f None admin] RBAC: Authorizing `identity:get_project(project_id=54996ce5552b4f828dd896d780833c36)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:38.789849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbe4bae-1064-4aa7-9570-c29936a39c2f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:38.791535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 585/1160] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:38 2022] GET /identity/v3/projects/54996ce5552b4f828dd896d780833c36 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:38.797656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4371997-d0f2-457a-a486-718e7940dc20 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:38.892716 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4371997-d0f2-457a-a486-718e7940dc20 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:38.925098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53583880-31af-46ed-9854-3ab5d29bc16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:38.925728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53583880-31af-46ed-9854-3ab5d29bc16a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:38.926007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53583880-31af-46ed-9854-3ab5d29bc16a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:38.926278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53583880-31af-46ed-9854-3ab5d29bc16a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:38.927090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53583880-31af-46ed-9854-3ab5d29bc16a None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=54996ce5552b4f828dd896d780833c36, user.id=8cdfaf4100794501a6a5208d7ea24720) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:38.927395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53583880-31af-46ed-9854-3ab5d29bc16a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:38.929418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53583880-31af-46ed-9854-3ab5d29bc16a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:38.935073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 576/1161] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:51:38 2022] GET /identity/v3/role_assignments?user.id=8cdfaf4100794501a6a5208d7ea24720&scope.project.id=54996ce5552b4f828dd896d780833c36&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:41.019682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c6db3-efdf-4975-94f5-b4efb1ab67aa None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:41.020273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c6db3-efdf-4975-94f5-b4efb1ab67aa None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:41.020273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c6db3-efdf-4975-94f5-b4efb1ab67aa None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:41.021677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 586/1162] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:41.027525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaaef8-4fa5-448d-a312-3e142362a7d8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:41.027983 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaaef8-4fa5-448d-a312-3e142362a7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:41.028084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beaaef8-4fa5-448d-a312-3e142362a7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:41.039674 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:41.045492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5beaaef8-4fa5-448d-a312-3e142362a7d8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:41.046689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5beaaef8-4fa5-448d-a312-3e142362a7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:41.116155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 577/1163] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:41.138711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c6db3-efdf-4975-94f5-b4efb1ab67aa None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:41.239231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c6db3-efdf-4975-94f5-b4efb1ab67aa None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:41.273122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735ca3f-5a4a-45ea-a52f-76db1c80fccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:41.273755 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ca3f-5a4a-45ea-a52f-76db1c80fccd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:41.274038 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ca3f-5a4a-45ea-a52f-76db1c80fccd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:41.274317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735ca3f-5a4a-45ea-a52f-76db1c80fccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:41.324593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:41.340334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735ca3f-5a4a-45ea-a52f-76db1c80fccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:41.346934 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735ca3f-5a4a-45ea-a52f-76db1c80fccd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:41.438440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 587/1164] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:41.445123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaaef8-4fa5-448d-a312-3e142362a7d8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:41.542187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beaaef8-4fa5-448d-a312-3e142362a7d8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:41.575777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3ec6f-3e9c-4df0-bb4b-e3ebec80968b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:41.576612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3ec6f-3e9c-4df0-bb4b-e3ebec80968b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:41.576896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3ec6f-3e9c-4df0-bb4b-e3ebec80968b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:41.577168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3ec6f-3e9c-4df0-bb4b-e3ebec80968b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:41.579804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:41.584295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3ec6f-3e9c-4df0-bb4b-e3ebec80968b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:41.585902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3ec6f-3e9c-4df0-bb4b-e3ebec80968b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1ca3ec6f-3e9c-4df0-bb4b-e3ebec80968b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:41.600223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:41.601866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:41.602791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 578/1165] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Jul 20 21:51:41 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:41.607509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735ca3f-5a4a-45ea-a52f-76db1c80fccd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:41.688916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:41.704699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735ca3f-5a4a-45ea-a52f-76db1c80fccd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:41.737472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e97ccdb-1d21-4b7f-8ba0-b4035b69d41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:41.738122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97ccdb-1d21-4b7f-8ba0-b4035b69d41c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:41.738403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97ccdb-1d21-4b7f-8ba0-b4035b69d41c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:41.738678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e97ccdb-1d21-4b7f-8ba0-b4035b69d41c None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:41.739387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97ccdb-1d21-4b7f-8ba0-b4035b69d41c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:41.739692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97ccdb-1d21-4b7f-8ba0-b4035b69d41c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:41.741628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e97ccdb-1d21-4b7f-8ba0-b4035b69d41c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:41.748650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 588/1166] 10.222.0.85 () {56 vars in 1115 bytes} [Wed Jul 20 21:51:41 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:43.745508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40911f17-1d5b-4c6c-9450-b2551bd4860a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:43.746110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40911f17-1d5b-4c6c-9450-b2551bd4860a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:43.746110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40911f17-1d5b-4c6c-9450-b2551bd4860a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:43.747459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 579/1167] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:43.752609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64811568-a671-485f-8d5d-a3447d22d7ee None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:43.753013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64811568-a671-485f-8d5d-a3447d22d7ee None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:43.753154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64811568-a671-485f-8d5d-a3447d22d7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:43.769700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-64811568-a671-485f-8d5d-a3447d22d7ee None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:43.770861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-64811568-a671-485f-8d5d-a3447d22d7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:43.833764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 589/1168] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:43.857105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40911f17-1d5b-4c6c-9450-b2551bd4860a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:43.955319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40911f17-1d5b-4c6c-9450-b2551bd4860a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:43.989956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919e3f17-3bf0-444e-a283-9c36f3c4a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:43.990614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e3f17-3bf0-444e-a283-9c36f3c4a77a None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:43.990898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e3f17-3bf0-444e-a283-9c36f3c4a77a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:43.991173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919e3f17-3bf0-444e-a283-9c36f3c4a77a None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:43.992121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e3f17-3bf0-444e-a283-9c36f3c4a77a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:43.993502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919e3f17-3bf0-444e-a283-9c36f3c4a77a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:44.075589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 580/1169] 10.222.0.85 () {60 vars in 1138 bytes} [Wed Jul 20 21:51:43 2022] POST /identity/v3/domains => generated 267 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:51:46.123607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5eb55-85eb-4600-b6a7-57706f4b08c6 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:46.124204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5eb55-85eb-4600-b6a7-57706f4b08c6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:46.124204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb5eb55-85eb-4600-b6a7-57706f4b08c6 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:46.125548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 590/1170] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:46.130847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f78cd1-d662-4ef6-b71c-0a19949ce5cc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:46.131270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f78cd1-d662-4ef6-b71c-0a19949ce5cc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:46.131440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f78cd1-d662-4ef6-b71c-0a19949ce5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:46.149284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b9f78cd1-d662-4ef6-b71c-0a19949ce5cc None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:46.150484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b9f78cd1-d662-4ef6-b71c-0a19949ce5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:46.199638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:46.216477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 581/1171] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:46.240385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5eb55-85eb-4600-b6a7-57706f4b08c6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:46.330878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:46.354187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb5eb55-85eb-4600-b6a7-57706f4b08c6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:46.386971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ef734-0814-426d-a7ac-f74966e4f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:46.387815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ef734-0814-426d-a7ac-f74966e4f9a0 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:46.388118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ef734-0814-426d-a7ac-f74966e4f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:46.388389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ef734-0814-426d-a7ac-f74966e4f9a0 None admin] PATH_INFO: `/v3/domains/6ab5f3328e5f41cba217cf0960cd0965` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:46.399256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ef734-0814-426d-a7ac-f74966e4f9a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6ab5f3328e5f41cba217cf0960cd0965)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:46.400714 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ef734-0814-426d-a7ac-f74966e4f9a0 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:46.402341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 591/1172] 10.222.0.85 () {56 vars in 1183 bytes} [Wed Jul 20 21:51:46 2022] GET /identity/v3/domains/6ab5f3328e5f41cba217cf0960cd0965 => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:46.408216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f78cd1-d662-4ef6-b71c-0a19949ce5cc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:46.508424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f78cd1-d662-4ef6-b71c-0a19949ce5cc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:46.543501 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de7ad0-180a-46b2-a156-41e3cf5c596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:46.544179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de7ad0-180a-46b2-a156-41e3cf5c596e None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:46.544465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de7ad0-180a-46b2-a156-41e3cf5c596e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:46.544742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de7ad0-180a-46b2-a156-41e3cf5c596e None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:46.545459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de7ad0-180a-46b2-a156-41e3cf5c596e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:46.547013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de7ad0-180a-46b2-a156-41e3cf5c596e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:46.630562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 582/1173] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:51:46 2022] POST /identity/v3/projects => generated 361 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:51:48.711070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de3fce-1616-4cc9-83ae-8cf075b31006 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:48.711631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de3fce-1616-4cc9-83ae-8cf075b31006 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:48.711631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de3fce-1616-4cc9-83ae-8cf075b31006 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:48.713003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 592/1174] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:48.718109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a8b9-ef98-456f-bff7-8cc6475b3e4d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:48.718532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a8b9-ef98-456f-bff7-8cc6475b3e4d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:48.718671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8321a8b9-ef98-456f-bff7-8cc6475b3e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:48.735910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8321a8b9-ef98-456f-bff7-8cc6475b3e4d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:48.737117 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8321a8b9-ef98-456f-bff7-8cc6475b3e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:48.766401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:48.810424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 583/1175] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:48.836897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de3fce-1616-4cc9-83ae-8cf075b31006 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:48.945320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de3fce-1616-4cc9-83ae-8cf075b31006 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:48.983495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644902e4-f719-49d1-ab5e-a5a451358ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:48.984397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644902e4-f719-49d1-ab5e-a5a451358ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:48.984678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644902e4-f719-49d1-ab5e-a5a451358ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:48.984957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644902e4-f719-49d1-ab5e-a5a451358ab6 None admin] PATH_INFO: `/v3/domains/6ab5f3328e5f41cba217cf0960cd0965` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:48.986125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644902e4-f719-49d1-ab5e-a5a451358ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6ab5f3328e5f41cba217cf0960cd0965)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:48.987548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644902e4-f719-49d1-ab5e-a5a451358ab6 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:48.989214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 593/1176] 10.222.0.85 () {56 vars in 1183 bytes} [Wed Jul 20 21:51:48 2022] GET /identity/v3/domains/6ab5f3328e5f41cba217cf0960cd0965 => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:48.995051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321a8b9-ef98-456f-bff7-8cc6475b3e4d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:49.093140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8321a8b9-ef98-456f-bff7-8cc6475b3e4d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:49.125998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32de81af-a9bc-4e97-bef6-026a767dc285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:49.126654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de81af-a9bc-4e97-bef6-026a767dc285 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:49.126934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de81af-a9bc-4e97-bef6-026a767dc285 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:49.127207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32de81af-a9bc-4e97-bef6-026a767dc285 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:49.127931 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de81af-a9bc-4e97-bef6-026a767dc285 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:49.129371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32de81af-a9bc-4e97-bef6-026a767dc285 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:49.206694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 584/1177] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:51:48 2022] POST /identity/v3/users => generated 311 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:51:51.359877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b8f64-606a-4fe7-a30b-5e11ab9dcf3f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:51.360448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b8f64-606a-4fe7-a30b-5e11ab9dcf3f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:51.360448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b8f64-606a-4fe7-a30b-5e11ab9dcf3f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:51.361829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 594/1178] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:51.367581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc124-8c7b-496e-845c-a20bde4eab39 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:51.368001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc124-8c7b-496e-845c-a20bde4eab39 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:51.368178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188cc124-8c7b-496e-845c-a20bde4eab39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:51.385029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-188cc124-8c7b-496e-845c-a20bde4eab39 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:51.386211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-188cc124-8c7b-496e-845c-a20bde4eab39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:51.403633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:51.452349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 585/1179] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:51.475456 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b8f64-606a-4fe7-a30b-5e11ab9dcf3f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:51.484626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:51.577000 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b8f64-606a-4fe7-a30b-5e11ab9dcf3f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:51.609468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c319b-9455-4fbc-a57f-10b3fa738207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:51.610297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c319b-9455-4fbc-a57f-10b3fa738207 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:51.610529 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c319b-9455-4fbc-a57f-10b3fa738207 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:51.610804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c319b-9455-4fbc-a57f-10b3fa738207 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:51.621930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c319b-9455-4fbc-a57f-10b3fa738207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c61c319b-9455-4fbc-a57f-10b3fa738207 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:51.629488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:51.630586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:51.631795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 595/1180] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:51.636840 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cc124-8c7b-496e-845c-a20bde4eab39 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:51.732271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188cc124-8c7b-496e-845c-a20bde4eab39 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:51.764699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bb5d0-f29b-4bf7-adae-142cfe448d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:51.765348 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bb5d0-f29b-4bf7-adae-142cfe448d39 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:51.765887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bb5d0-f29b-4bf7-adae-142cfe448d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:51.766159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bb5d0-f29b-4bf7-adae-142cfe448d39 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:51.766893 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bb5d0-f29b-4bf7-adae-142cfe448d39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:51.767194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bb5d0-f29b-4bf7-adae-142cfe448d39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:51.768578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bb5d0-f29b-4bf7-adae-142cfe448d39 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:51.776402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 586/1181] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:51:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:51.782144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c319b-9455-4fbc-a57f-10b3fa738207 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:51.847707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:51.912972 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c319b-9455-4fbc-a57f-10b3fa738207 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:51.945256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22346-6458-4958-b3b3-41ebd5674301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:51.946108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22346-6458-4958-b3b3-41ebd5674301 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:51.946385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22346-6458-4958-b3b3-41ebd5674301 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:51.946652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a22346-6458-4958-b3b3-41ebd5674301 None admin] PATH_INFO: `/v3/users/4c925d0c476743f980e31be3d59aa00a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:51.960599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a22346-6458-4958-b3b3-41ebd5674301 None admin] RBAC: Authorizing `identity:get_user(user_id=4c925d0c476743f980e31be3d59aa00a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:51.962033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a22346-6458-4958-b3b3-41ebd5674301 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:51.963766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 596/1182] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:51 2022] GET /identity/v3/users/4c925d0c476743f980e31be3d59aa00a => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:51.969568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bb5d0-f29b-4bf7-adae-142cfe448d39 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:51.987744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:52.067123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bb5d0-f29b-4bf7-adae-142cfe448d39 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:52.099192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7e216-0bd8-4bf4-a1b4-7839a938a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:52.100168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7e216-0bd8-4bf4-a1b4-7839a938a857 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:52.100168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7e216-0bd8-4bf4-a1b4-7839a938a857 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:52.100455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f7e216-0bd8-4bf4-a1b4-7839a938a857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:52.165152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7e216-0bd8-4bf4-a1b4-7839a938a857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:52.166517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f7e216-0bd8-4bf4-a1b4-7839a938a857 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:52.182883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:52.264640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 587/1183] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:52.271122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22346-6458-4958-b3b3-41ebd5674301 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:52.370746 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a22346-6458-4958-b3b3-41ebd5674301 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:52.393693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:52.404405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb2b6c8-6536-4497-8a4d-c46699a2db65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:52.405284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2b6c8-6536-4497-8a4d-c46699a2db65 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:52.405582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2b6c8-6536-4497-8a4d-c46699a2db65 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:52.405840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2b6c8-6536-4497-8a4d-c46699a2db65 None admin] PATH_INFO: `/v3/projects/cd01112899f345a2bf2b5101283ee0dc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:52.407048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2b6c8-6536-4497-8a4d-c46699a2db65 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01112899f345a2bf2b5101283ee0dc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:52.408511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb2b6c8-6536-4497-8a4d-c46699a2db65 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:52.410289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 597/1184] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:52 2022] GET /identity/v3/projects/cd01112899f345a2bf2b5101283ee0dc => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:52.417413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7e216-0bd8-4bf4-a1b4-7839a938a857 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:52.513720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f7e216-0bd8-4bf4-a1b4-7839a938a857 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:52.530579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:52.548027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2d38b0-3d36-4326-a823-12cbfbe72f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:52.548671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d38b0-3d36-4326-a823-12cbfbe72f80 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:52.548950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d38b0-3d36-4326-a823-12cbfbe72f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:52.551698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2d38b0-3d36-4326-a823-12cbfbe72f80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:52.551698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d38b0-3d36-4326-a823-12cbfbe72f80 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=cd01112899f345a2bf2b5101283ee0dc, user.id=4c925d0c476743f980e31be3d59aa00a) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:52.551698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d38b0-3d36-4326-a823-12cbfbe72f80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:52.551698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2d38b0-3d36-4326-a823-12cbfbe72f80 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:52.557888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 588/1185] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:51:52 2022] GET /identity/v3/role_assignments?user.id=4c925d0c476743f980e31be3d59aa00a&scope.project.id=cd01112899f345a2bf2b5101283ee0dc&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:54.541848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297033-a9a4-4b0e-bfe2-d324ba6c6392 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:54.542381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297033-a9a4-4b0e-bfe2-d324ba6c6392 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:54.542381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71297033-a9a4-4b0e-bfe2-d324ba6c6392 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:54.543750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 598/1186] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:54.548830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081043e-2f9f-49ce-a7f5-4d0159f2fbfe None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:54.549252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081043e-2f9f-49ce-a7f5-4d0159f2fbfe None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:54.549378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5081043e-2f9f-49ce-a7f5-4d0159f2fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:54.566226 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5081043e-2f9f-49ce-a7f5-4d0159f2fbfe None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:54.567392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5081043e-2f9f-49ce-a7f5-4d0159f2fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:54.633199 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 589/1187] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:54.655846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297033-a9a4-4b0e-bfe2-d324ba6c6392 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:54.755113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71297033-a9a4-4b0e-bfe2-d324ba6c6392 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:54.788196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f380b-dd6f-4725-89f8-8e32922b0e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:54.788967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f380b-dd6f-4725-89f8-8e32922b0e5a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:54.789248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f380b-dd6f-4725-89f8-8e32922b0e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:54.789522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f380b-dd6f-4725-89f8-8e32922b0e5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:54.799440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f380b-dd6f-4725-89f8-8e32922b0e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-4b4f380b-dd6f-4725-89f8-8e32922b0e5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:54.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:54.808826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:51:54.809693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 599/1188] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:51:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:51:54.814860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081043e-2f9f-49ce-a7f5-4d0159f2fbfe None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:54.915766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5081043e-2f9f-49ce-a7f5-4d0159f2fbfe None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:54.926112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:54.949608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67ac52-40b7-4609-9512-50f144fb71b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:54.950279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67ac52-40b7-4609-9512-50f144fb71b0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:54.950568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67ac52-40b7-4609-9512-50f144fb71b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:54.950844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67ac52-40b7-4609-9512-50f144fb71b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:54.951657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67ac52-40b7-4609-9512-50f144fb71b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:54.951905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67ac52-40b7-4609-9512-50f144fb71b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:54.953360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67ac52-40b7-4609-9512-50f144fb71b0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:54.962245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 590/1189] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:51:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:54.968486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f380b-dd6f-4725-89f8-8e32922b0e5a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:55.019910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:55.066037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f380b-dd6f-4725-89f8-8e32922b0e5a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:55.098127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a426fd-4255-4b75-bad4-7ba17642f5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:55.098979 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a426fd-4255-4b75-bad4-7ba17642f5a3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:55.099255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a426fd-4255-4b75-bad4-7ba17642f5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:55.099520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a426fd-4255-4b75-bad4-7ba17642f5a3 None admin] PATH_INFO: `/v3/users/4c925d0c476743f980e31be3d59aa00a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:55.101370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a426fd-4255-4b75-bad4-7ba17642f5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=4c925d0c476743f980e31be3d59aa00a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:55.102790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a426fd-4255-4b75-bad4-7ba17642f5a3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:55.104421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 600/1190] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:54 2022] GET /identity/v3/users/4c925d0c476743f980e31be3d59aa00a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:55.111012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67ac52-40b7-4609-9512-50f144fb71b0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:55.208419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67ac52-40b7-4609-9512-50f144fb71b0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:55.241721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373d3e5-f9c2-4e10-a698-229669b70334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:55.242567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373d3e5-f9c2-4e10-a698-229669b70334 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:55.242849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373d3e5-f9c2-4e10-a698-229669b70334 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:55.243123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373d3e5-f9c2-4e10-a698-229669b70334 None admin] PATH_INFO: `/v3/projects/cd01112899f345a2bf2b5101283ee0dc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:55.244306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373d3e5-f9c2-4e10-a698-229669b70334 None admin] RBAC: Authorizing `identity:get_project(project_id=cd01112899f345a2bf2b5101283ee0dc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:55.245730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373d3e5-f9c2-4e10-a698-229669b70334 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:55.247402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 591/1191] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:55 2022] GET /identity/v3/projects/cd01112899f345a2bf2b5101283ee0dc => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:51:55.254222 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a426fd-4255-4b75-bad4-7ba17642f5a3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:55.352121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a426fd-4255-4b75-bad4-7ba17642f5a3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:55.370750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:55.384592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3812bf65-e1aa-45b1-8cb6-fb520ef1db87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:55.385474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812bf65-e1aa-45b1-8cb6-fb520ef1db87 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:55.385752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812bf65-e1aa-45b1-8cb6-fb520ef1db87 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:55.386021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3812bf65-e1aa-45b1-8cb6-fb520ef1db87 None admin] PATH_INFO: `/v3/projects/cd01112899f345a2bf2b5101283ee0dc/users/4c925d0c476743f980e31be3d59aa00a/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:55.387961 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812bf65-e1aa-45b1-8cb6-fb520ef1db87 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd01112899f345a2bf2b5101283ee0dc, user_id=4c925d0c476743f980e31be3d59aa00a, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:55.389423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3812bf65-e1aa-45b1-8cb6-fb520ef1db87 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:55.457582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 601/1192] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:51:55 2022] PUT /identity/v3/projects/cd01112899f345a2bf2b5101283ee0dc/users/4c925d0c476743f980e31be3d59aa00a/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:51:57.461397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7780-45ae-436c-a55c-d8988dbad2b6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:57.461961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7780-45ae-436c-a55c-d8988dbad2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:57.461961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e7780-45ae-436c-a55c-d8988dbad2b6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:57.463301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 592/1193] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:51:57.468560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f80f0-3d05-4c51-a4cf-640a13706bac None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:57.468933 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f80f0-3d05-4c51-a4cf-640a13706bac None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:57.469111 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31f80f0-3d05-4c51-a4cf-640a13706bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:57.485394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a31f80f0-3d05-4c51-a4cf-640a13706bac None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:51:57.486566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a31f80f0-3d05-4c51-a4cf-640a13706bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:51:57.553825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 602/1194] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:51:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:51:57.577224 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e7780-45ae-436c-a55c-d8988dbad2b6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:57.620429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:57.679326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e7780-45ae-436c-a55c-d8988dbad2b6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:57.711582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb94f5-893e-4a8a-a967-81aac1797b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:57.712306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb94f5-893e-4a8a-a967-81aac1797b93 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:57.712581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb94f5-893e-4a8a-a967-81aac1797b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:57.712859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb94f5-893e-4a8a-a967-81aac1797b93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:57.722656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb94f5-893e-4a8a-a967-81aac1797b93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-52fb94f5-893e-4a8a-a967-81aac1797b93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:51:57.730885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:51:57.731829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:51:57.732763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 593/1195] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:51:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:51:57.738155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f80f0-3d05-4c51-a4cf-640a13706bac None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:57.834780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31f80f0-3d05-4c51-a4cf-640a13706bac None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:57.845222 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:57.868886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f03ec-8ad5-478e-873c-377687983072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:57.869529 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f03ec-8ad5-478e-873c-377687983072 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:57.869805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f03ec-8ad5-478e-873c-377687983072 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:57.870074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f03ec-8ad5-478e-873c-377687983072 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:57.870807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f03ec-8ad5-478e-873c-377687983072 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:57.871107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f03ec-8ad5-478e-873c-377687983072 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:57.872489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f03ec-8ad5-478e-873c-377687983072 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:57.880193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 603/1196] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:57.886135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb94f5-893e-4a8a-a967-81aac1797b93 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:57.992914 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:57.995746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb94f5-893e-4a8a-a967-81aac1797b93 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:58.029280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cae03-07b4-4a1a-a727-8fc8c8fbf8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:58.030142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cae03-07b4-4a1a-a727-8fc8c8fbf8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:58.030425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cae03-07b4-4a1a-a727-8fc8c8fbf8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:58.030696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733cae03-07b4-4a1a-a727-8fc8c8fbf8c4 None admin] PATH_INFO: `/v3/users/4c925d0c476743f980e31be3d59aa00a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:58.031866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cae03-07b4-4a1a-a727-8fc8c8fbf8c4 None admin] RBAC: Authorizing `identity:get_user(user_id=4c925d0c476743f980e31be3d59aa00a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:58.033334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733cae03-07b4-4a1a-a727-8fc8c8fbf8c4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:58.034965 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 594/1197] 10.222.0.85 () {56 vars in 1177 bytes} [Wed Jul 20 21:51:57 2022] GET /identity/v3/users/4c925d0c476743f980e31be3d59aa00a => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:58.041894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f03ec-8ad5-478e-873c-377687983072 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:58.138244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f03ec-8ad5-478e-873c-377687983072 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:58.171902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e7853-e8fd-48a4-85a7-ac3f6024126b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:58.172565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7853-e8fd-48a4-85a7-ac3f6024126b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:58.172849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7853-e8fd-48a4-85a7-ac3f6024126b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:58.173124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464e7853-e8fd-48a4-85a7-ac3f6024126b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:58.216902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:58.242758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7853-e8fd-48a4-85a7-ac3f6024126b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:58.244350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464e7853-e8fd-48a4-85a7-ac3f6024126b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:58.340167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 604/1198] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:51:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:51:58.346069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cae03-07b4-4a1a-a727-8fc8c8fbf8c4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:58.443184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733cae03-07b4-4a1a-a727-8fc8c8fbf8c4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:58.475883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6308a8c-d027-485d-a50e-0ce9ac20f50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:58.476751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6308a8c-d027-485d-a50e-0ce9ac20f50d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:58.477027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6308a8c-d027-485d-a50e-0ce9ac20f50d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:58.477294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6308a8c-d027-485d-a50e-0ce9ac20f50d None admin] PATH_INFO: `/v3/projects/cd01112899f345a2bf2b5101283ee0dc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:58.478452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6308a8c-d027-485d-a50e-0ce9ac20f50d None admin] RBAC: Authorizing `identity:get_project(project_id=cd01112899f345a2bf2b5101283ee0dc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:58.479879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6308a8c-d027-485d-a50e-0ce9ac20f50d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:58.481583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 595/1199] 10.222.0.85 () {56 vars in 1186 bytes} [Wed Jul 20 21:51:58 2022] GET /identity/v3/projects/cd01112899f345a2bf2b5101283ee0dc => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:51:58.487721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e7853-e8fd-48a4-85a7-ac3f6024126b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:51:58.556231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:51:58.585976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464e7853-e8fd-48a4-85a7-ac3f6024126b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:51:58.619136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4db80e-3853-4543-97a6-b8274a993a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:51:58.619781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4db80e-3853-4543-97a6-b8274a993a36 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:51:58.620101 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4db80e-3853-4543-97a6-b8274a993a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:51:58.620379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4db80e-3853-4543-97a6-b8274a993a36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:51:58.621230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4db80e-3853-4543-97a6-b8274a993a36 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=cd01112899f345a2bf2b5101283ee0dc, user.id=4c925d0c476743f980e31be3d59aa00a) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:51:58.621540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4db80e-3853-4543-97a6-b8274a993a36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:51:58.622963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4db80e-3853-4543-97a6-b8274a993a36 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:51:58.628696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 605/1200] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:51:58 2022] GET /identity/v3/role_assignments?user.id=4c925d0c476743f980e31be3d59aa00a&scope.project.id=cd01112899f345a2bf2b5101283ee0dc&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:52:08.471783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=82 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:52:08.626026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=32 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:12.828024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46470-c23a-481c-9d61-cabf6750371c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:12.828621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46470-c23a-481c-9d61-cabf6750371c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:12.828621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f46470-c23a-481c-9d61-cabf6750371c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:12.829976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 596/1201] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:53:12.835046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec19d-b220-4f7a-8463-0636026745cb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:12.835494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec19d-b220-4f7a-8463-0636026745cb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:12.835601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec19d-b220-4f7a-8463-0636026745cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:12.852752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-91aec19d-b220-4f7a-8463-0636026745cb None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:12.853936 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-91aec19d-b220-4f7a-8463-0636026745cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:12.922566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 606/1202] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:12.949502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f46470-c23a-481c-9d61-cabf6750371c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:13.055246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f46470-c23a-481c-9d61-cabf6750371c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:13.094485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b16e54-6be7-4fd3-8c0a-3baf6a650a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:13.094485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b16e54-6be7-4fd3-8c0a-3baf6a650a69 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:13.094485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b16e54-6be7-4fd3-8c0a-3baf6a650a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:13.094485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b16e54-6be7-4fd3-8c0a-3baf6a650a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:13.104204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b16e54-6be7-4fd3-8c0a-3baf6a650a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:13.105630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b16e54-6be7-4fd3-8c0a-3baf6a650a69 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a7b16e54-6be7-4fd3-8c0a-3baf6a650a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:13.123268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:13.124494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:13.125685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:13.125685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:13.125685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:13.125685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:13.125685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 597/1203] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:13.130808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec19d-b220-4f7a-8463-0636026745cb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:13.232717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec19d-b220-4f7a-8463-0636026745cb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:13.261244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:13.266944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46084df-75eb-4d25-85bb-ca1be261f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:13.267852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46084df-75eb-4d25-85bb-ca1be261f2bc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:13.268736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46084df-75eb-4d25-85bb-ca1be261f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:13.269274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46084df-75eb-4d25-85bb-ca1be261f2bc None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:13.269658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46084df-75eb-4d25-85bb-ca1be261f2bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:13.269957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46084df-75eb-4d25-85bb-ca1be261f2bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:13.271304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46084df-75eb-4d25-85bb-ca1be261f2bc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:13.282290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 607/1204] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:13.288130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b16e54-6be7-4fd3-8c0a-3baf6a650a69 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:13.342309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:13.389686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b16e54-6be7-4fd3-8c0a-3baf6a650a69 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:13.421902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebfdbbf-a4c4-4b35-8ff3-8b4d0c7029c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:13.422562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfdbbf-a4c4-4b35-8ff3-8b4d0c7029c6 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:13.422843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfdbbf-a4c4-4b35-8ff3-8b4d0c7029c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:13.423118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebfdbbf-a4c4-4b35-8ff3-8b4d0c7029c6 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:13.423820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfdbbf-a4c4-4b35-8ff3-8b4d0c7029c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:13.425915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebfdbbf-a4c4-4b35-8ff3-8b4d0c7029c6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:13.592159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 598/1205] 10.222.0.85 () {60 vars in 1132 bytes} [Wed Jul 20 21:53:13 2022] POST /identity/v3/users => generated 251 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:53:15.741441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327541-e19f-4deb-a087-94a74f421333 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:15.742000 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327541-e19f-4deb-a087-94a74f421333 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:15.742000 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05327541-e19f-4deb-a087-94a74f421333 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:15.743505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 608/1206] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:53:15.748929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b5f5-9a2d-4523-b6d6-63323cd5adcb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:15.749319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b5f5-9a2d-4523-b6d6-63323cd5adcb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:15.749485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0b5f5-9a2d-4523-b6d6-63323cd5adcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:15.766242 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4fb0b5f5-9a2d-4523-b6d6-63323cd5adcb None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:15.767398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4fb0b5f5-9a2d-4523-b6d6-63323cd5adcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:15.835863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 599/1207] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:15.860171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05327541-e19f-4deb-a087-94a74f421333 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:15.966083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05327541-e19f-4deb-a087-94a74f421333 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:16.000586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffbaaf-67db-422b-bbdc-6844f7fdf474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:16.001304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffbaaf-67db-422b-bbdc-6844f7fdf474 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:16.001588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffbaaf-67db-422b-bbdc-6844f7fdf474 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:16.001944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffbaaf-67db-422b-bbdc-6844f7fdf474 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:16.013236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffbaaf-67db-422b-bbdc-6844f7fdf474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-a5ffbaaf-67db-422b-bbdc-6844f7fdf474 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:53:16.021748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:16.022875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:16.024058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 609/1208] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:53:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:16.029133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0b5f5-9a2d-4523-b6d6-63323cd5adcb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:16.068094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:16.126227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0b5f5-9a2d-4523-b6d6-63323cd5adcb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:16.162415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd4991-f7d8-4526-be01-9ba6f39addf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:16.163185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd4991-f7d8-4526-be01-9ba6f39addf9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:16.163501 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd4991-f7d8-4526-be01-9ba6f39addf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:16.163781 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd4991-f7d8-4526-be01-9ba6f39addf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:16.164606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd4991-f7d8-4526-be01-9ba6f39addf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:16.164918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd4991-f7d8-4526-be01-9ba6f39addf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:16.166523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd4991-f7d8-4526-be01-9ba6f39addf9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:16.174979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 600/1209] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:53:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:16.180897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffbaaf-67db-422b-bbdc-6844f7fdf474 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:16.230544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:16.278743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffbaaf-67db-422b-bbdc-6844f7fdf474 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:16.311567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a32bf-7570-4632-84c0-ef6c0963cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:16.312417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a32bf-7570-4632-84c0-ef6c0963cb9a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:16.312698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a32bf-7570-4632-84c0-ef6c0963cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:16.312966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a32bf-7570-4632-84c0-ef6c0963cb9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:16.323228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a32bf-7570-4632-84c0-ef6c0963cb9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:16.324744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a32bf-7570-4632-84c0-ef6c0963cb9a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-6c1a32bf-7570-4632-84c0-ef6c0963cb9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:16.341445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:16.342512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:16.343451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:16.343451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:16.343451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:16.343451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:16.343451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 610/1210] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:53:16.349212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd4991-f7d8-4526-be01-9ba6f39addf9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:16.450533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:16.453810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd4991-f7d8-4526-be01-9ba6f39addf9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:16.488534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa911e85-5b4e-4ba5-a9b7-e2fe02e8287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:16.489198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911e85-5b4e-4ba5-a9b7-e2fe02e8287a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:16.489511 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911e85-5b4e-4ba5-a9b7-e2fe02e8287a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:16.489829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa911e85-5b4e-4ba5-a9b7-e2fe02e8287a None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:16.490609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa911e85-5b4e-4ba5-a9b7-e2fe02e8287a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:16.490925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa911e85-5b4e-4ba5-a9b7-e2fe02e8287a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:16.492359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa911e85-5b4e-4ba5-a9b7-e2fe02e8287a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:16.506019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 601/1211] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:53:16.511837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a32bf-7570-4632-84c0-ef6c0963cb9a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:16.609467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a32bf-7570-4632-84c0-ef6c0963cb9a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:16.610925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:16.643419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca11d5-701e-4ae9-a70b-3cc0844b5fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:16.644299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca11d5-701e-4ae9-a70b-3cc0844b5fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:16.644581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca11d5-701e-4ae9-a70b-3cc0844b5fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:16.644852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca11d5-701e-4ae9-a70b-3cc0844b5fc3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:16.651593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca11d5-701e-4ae9-a70b-3cc0844b5fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:16.653054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ca11d5-701e-4ae9-a70b-3cc0844b5fc3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-37ca11d5-701e-4ae9-a70b-3cc0844b5fc3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:53:16.667822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:16.668946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:16.671201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 611/1212] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:53:16.675555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa911e85-5b4e-4ba5-a9b7-e2fe02e8287a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:16.773601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa911e85-5b4e-4ba5-a9b7-e2fe02e8287a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:16.807279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27693dc1-0e07-42ba-b06d-a971feb72ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:16.808138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27693dc1-0e07-42ba-b06d-a971feb72ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:16.808271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27693dc1-0e07-42ba-b06d-a971feb72ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:16.808542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27693dc1-0e07-42ba-b06d-a971feb72ac3 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:16.809381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27693dc1-0e07-42ba-b06d-a971feb72ac3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:16.809683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27693dc1-0e07-42ba-b06d-a971feb72ac3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:16.811127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27693dc1-0e07-42ba-b06d-a971feb72ac3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:16.828225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 602/1213] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Jul 20 21:53:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:16.834270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca11d5-701e-4ae9-a70b-3cc0844b5fc3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:16.933955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ca11d5-701e-4ae9-a70b-3cc0844b5fc3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:16.969549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854615-3127-410e-aa31-28e8e3f9d370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:16.970194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854615-3127-410e-aa31-28e8e3f9d370 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:16.970471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854615-3127-410e-aa31-28e8e3f9d370 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:16.970738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45854615-3127-410e-aa31-28e8e3f9d370 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:17.001235 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:17.039053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45854615-3127-410e-aa31-28e8e3f9d370 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:17.040533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45854615-3127-410e-aa31-28e8e3f9d370 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:17.138365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 612/1214] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:53:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:53:17.146141 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27693dc1-0e07-42ba-b06d-a971feb72ac3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:17.166243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:17.247859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27693dc1-0e07-42ba-b06d-a971feb72ac3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:17.282818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a145-ee36-4e89-b5bb-3232f25c48fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:17.283717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a145-ee36-4e89-b5bb-3232f25c48fc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:17.284613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a145-ee36-4e89-b5bb-3232f25c48fc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:17.284885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a145-ee36-4e89-b5bb-3232f25c48fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:17.294672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a145-ee36-4e89-b5bb-3232f25c48fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:17.296175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a145-ee36-4e89-b5bb-3232f25c48fc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0216a145-ee36-4e89-b5bb-3232f25c48fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:17.313144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:17.314215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:17.315319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:17.315319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:17.315319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:17.315319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:17.315319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 603/1215] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:17.320387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854615-3127-410e-aa31-28e8e3f9d370 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:17.380776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:17.419887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45854615-3127-410e-aa31-28e8e3f9d370 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:17.453642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1409fe3-6882-4044-ac00-da895767ca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:17.454292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1409fe3-6882-4044-ac00-da895767ca70 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:17.454613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1409fe3-6882-4044-ac00-da895767ca70 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:17.454887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1409fe3-6882-4044-ac00-da895767ca70 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:17.456838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1409fe3-6882-4044-ac00-da895767ca70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:17.462100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1409fe3-6882-4044-ac00-da895767ca70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:17.462100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1409fe3-6882-4044-ac00-da895767ca70 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:17.470504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 613/1216] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:17.476361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a145-ee36-4e89-b5bb-3232f25c48fc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:17.547477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:17.577689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a145-ee36-4e89-b5bb-3232f25c48fc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:17.612704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1eeea-5a68-427a-aed7-35f056ce7558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:17.613515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1eeea-5a68-427a-aed7-35f056ce7558 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:17.613836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1eeea-5a68-427a-aed7-35f056ce7558 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:17.614116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1eeea-5a68-427a-aed7-35f056ce7558 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:17.621641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1eeea-5a68-427a-aed7-35f056ce7558 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1eeea-5a68-427a-aed7-35f056ce7558 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f5b1eeea-5a68-427a-aed7-35f056ce7558 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:17.640101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:17.641442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:17.642546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 604/1217] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:53:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:17.645899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1409fe3-6882-4044-ac00-da895767ca70 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:17.745002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1409fe3-6882-4044-ac00-da895767ca70 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:17.772310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:17.783512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b1846-4238-4d94-91a9-690a7b4df7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:17.784321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b1846-4238-4d94-91a9-690a7b4df7e9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:17.784602 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b1846-4238-4d94-91a9-690a7b4df7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:17.784872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b1846-4238-4d94-91a9-690a7b4df7e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:17.785661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b1846-4238-4d94-91a9-690a7b4df7e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:17.785965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b1846-4238-4d94-91a9-690a7b4df7e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:17.787493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5b1846-4238-4d94-91a9-690a7b4df7e9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:17.800159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 614/1218] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:53:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:17.806287 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1eeea-5a68-427a-aed7-35f056ce7558 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:17.909580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1eeea-5a68-427a-aed7-35f056ce7558 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:17.939121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:17.946905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0c1238-9007-4724-84be-7847c2e63eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:17.947484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c1238-9007-4724-84be-7847c2e63eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:17.947766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c1238-9007-4724-84be-7847c2e63eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:17.948068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c1238-9007-4724-84be-7847c2e63eb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:17.948905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c1238-9007-4724-84be-7847c2e63eb2 None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=4e52a3464d8f4a3fa16a102336a4bbf6) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:17.949217 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c1238-9007-4724-84be-7847c2e63eb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:17.950656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0c1238-9007-4724-84be-7847c2e63eb2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:17.956608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 605/1219] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:53:17 2022] GET /identity/v3/role_assignments?user.id=4e52a3464d8f4a3fa16a102336a4bbf6&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:20.012257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0ad18-e733-4947-8ea6-5d20499d767d None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:20.012776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0ad18-e733-4947-8ea6-5d20499d767d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:20.012887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e0ad18-e733-4947-8ea6-5d20499d767d None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:20.014176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 615/1220] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:53:20.020217 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a717e37-76e5-479d-81ab-f1d8d1bbbdbe None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:20.021576 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a717e37-76e5-479d-81ab-f1d8d1bbbdbe None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:20.021576 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a717e37-76e5-479d-81ab-f1d8d1bbbdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:20.038436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8a717e37-76e5-479d-81ab-f1d8d1bbbdbe None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:20.039727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8a717e37-76e5-479d-81ab-f1d8d1bbbdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:20.108991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 606/1221] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:20.132059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0ad18-e733-4947-8ea6-5d20499d767d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:20.234360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e0ad18-e733-4947-8ea6-5d20499d767d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:20.267018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796101f-0dd6-4063-86f0-8faae7e6cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:20.267791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796101f-0dd6-4063-86f0-8faae7e6cb7b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:20.268654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796101f-0dd6-4063-86f0-8faae7e6cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:20.268927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796101f-0dd6-4063-86f0-8faae7e6cb7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:20.278688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6796101f-0dd6-4063-86f0-8faae7e6cb7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-6796101f-0dd6-4063-86f0-8faae7e6cb7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:53:20.287269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:20.288384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:20.289240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 616/1222] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:20.294637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a717e37-76e5-479d-81ab-f1d8d1bbbdbe None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:20.396644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a717e37-76e5-479d-81ab-f1d8d1bbbdbe None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:20.420915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:20.432325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ac6c2-0d41-40b9-8f1c-fefacd18c29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:20.433072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ac6c2-0d41-40b9-8f1c-fefacd18c29e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:20.433374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ac6c2-0d41-40b9-8f1c-fefacd18c29e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:20.433651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ac6c2-0d41-40b9-8f1c-fefacd18c29e None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:20.434418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ac6c2-0d41-40b9-8f1c-fefacd18c29e None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:20.434726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ac6c2-0d41-40b9-8f1c-fefacd18c29e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:20.436130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ac6c2-0d41-40b9-8f1c-fefacd18c29e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:20.444670 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 607/1223] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:53:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:20.450705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796101f-0dd6-4063-86f0-8faae7e6cb7b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:20.493779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:20.548502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796101f-0dd6-4063-86f0-8faae7e6cb7b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:20.580459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f26aa-8966-4094-8349-9f6a6faeb6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:20.581236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f26aa-8966-4094-8349-9f6a6faeb6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:20.581515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f26aa-8966-4094-8349-9f6a6faeb6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:20.581787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f26aa-8966-4094-8349-9f6a6faeb6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:20.591754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f26aa-8966-4094-8349-9f6a6faeb6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:20.593214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f26aa-8966-4094-8349-9f6a6faeb6d1 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-cc7f26aa-8966-4094-8349-9f6a6faeb6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:20.611425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:20.612444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:20.614212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:20.614212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:20.614212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:20.614212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:20.614212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 617/1224] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:20.619294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ac6c2-0d41-40b9-8f1c-fefacd18c29e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:20.720766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ac6c2-0d41-40b9-8f1c-fefacd18c29e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:20.754106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6d93c-686e-4dff-b5e0-7510be092708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:20.754692 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6d93c-686e-4dff-b5e0-7510be092708 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:20.754967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6d93c-686e-4dff-b5e0-7510be092708 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:20.755236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca6d93c-686e-4dff-b5e0-7510be092708 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:20.755970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6d93c-686e-4dff-b5e0-7510be092708 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:20.756272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6d93c-686e-4dff-b5e0-7510be092708 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:20.757626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca6d93c-686e-4dff-b5e0-7510be092708 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:20.769241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 608/1225] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:20.775003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f26aa-8966-4094-8349-9f6a6faeb6d1 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:20.869880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:20.876297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f26aa-8966-4094-8349-9f6a6faeb6d1 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:20.909379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564cf83-79c5-45e9-85bf-e3815dcb0538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:20.910161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564cf83-79c5-45e9-85bf-e3815dcb0538 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:20.910439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564cf83-79c5-45e9-85bf-e3815dcb0538 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:20.910705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9564cf83-79c5-45e9-85bf-e3815dcb0538 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:20.917861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564cf83-79c5-45e9-85bf-e3815dcb0538 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:20.919283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9564cf83-79c5-45e9-85bf-e3815dcb0538 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-9564cf83-79c5-45e9-85bf-e3815dcb0538 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:53:20.933260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:20.934353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:20.935682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 618/1226] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:20.940513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6d93c-686e-4dff-b5e0-7510be092708 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:20.988563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:21.041581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca6d93c-686e-4dff-b5e0-7510be092708 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:21.075033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd727be-ef0d-4c84-bf81-9765913791e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:21.075685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd727be-ef0d-4c84-bf81-9765913791e2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:21.075988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd727be-ef0d-4c84-bf81-9765913791e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:21.076262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd727be-ef0d-4c84-bf81-9765913791e2 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:21.077088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd727be-ef0d-4c84-bf81-9765913791e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:21.077391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd727be-ef0d-4c84-bf81-9765913791e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:21.078822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd727be-ef0d-4c84-bf81-9765913791e2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:21.097602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 609/1227] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Jul 20 21:53:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:21.103268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564cf83-79c5-45e9-85bf-e3815dcb0538 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:21.207731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9564cf83-79c5-45e9-85bf-e3815dcb0538 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:21.240597 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14529f9-b38f-45d5-813a-d36285212dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:21.241376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14529f9-b38f-45d5-813a-d36285212dcd None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:21.241656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14529f9-b38f-45d5-813a-d36285212dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:21.241925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14529f9-b38f-45d5-813a-d36285212dcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:21.253131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14529f9-b38f-45d5-813a-d36285212dcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:21.254571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14529f9-b38f-45d5-813a-d36285212dcd None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-c14529f9-b38f-45d5-813a-d36285212dcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:21.272417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:21.273541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:21.274644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:21.274644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:21.274644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:21.274644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:21.274644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 619/1228] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:21.279349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd727be-ef0d-4c84-bf81-9765913791e2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:21.380389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd727be-ef0d-4c84-bf81-9765913791e2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:21.387699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:21.415264 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a2085-5e46-4aec-94dd-24dc4987fa9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:21.415999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2085-5e46-4aec-94dd-24dc4987fa9f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:21.416286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2085-5e46-4aec-94dd-24dc4987fa9f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:21.416565 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66a2085-5e46-4aec-94dd-24dc4987fa9f None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:21.417304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a2085-5e46-4aec-94dd-24dc4987fa9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:21.417597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a2085-5e46-4aec-94dd-24dc4987fa9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:21.418974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66a2085-5e46-4aec-94dd-24dc4987fa9f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:21.430446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 610/1229] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:21.436199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14529f9-b38f-45d5-813a-d36285212dcd None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:21.446121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:21.534940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14529f9-b38f-45d5-813a-d36285212dcd None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:21.567362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f093a-f420-4998-8250-9fa29c394e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:21.568160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f093a-f420-4998-8250-9fa29c394e1a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:21.568440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f093a-f420-4998-8250-9fa29c394e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:21.568708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f093a-f420-4998-8250-9fa29c394e1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:21.575167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f093a-f420-4998-8250-9fa29c394e1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:21.576737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3f093a-f420-4998-8250-9fa29c394e1a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-5d3f093a-f420-4998-8250-9fa29c394e1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:53:21.591900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:21.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:21.599973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:53:21.599973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:53:21.599973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:53:21.599973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:53:21.599973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:53:21.599973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:53:21.599973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:21.599973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:21.599973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 620/1230] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:21.600621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a2085-5e46-4aec-94dd-24dc4987fa9f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:21.701271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66a2085-5e46-4aec-94dd-24dc4987fa9f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:21.733972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a3e1e-bc00-4a2f-aabf-f25afde2d0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:21.743023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a3e1e-bc00-4a2f-aabf-f25afde2d0ad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:21.743023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a3e1e-bc00-4a2f-aabf-f25afde2d0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:21.743023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a3e1e-bc00-4a2f-aabf-f25afde2d0ad None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:21.743023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a3e1e-bc00-4a2f-aabf-f25afde2d0ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:21.743023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a3e1e-bc00-4a2f-aabf-f25afde2d0ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:21.743023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a3e1e-bc00-4a2f-aabf-f25afde2d0ad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:21.750324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 611/1231] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:21.757288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f093a-f420-4998-8250-9fa29c394e1a None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:21.824726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:21.858923 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f093a-f420-4998-8250-9fa29c394e1a None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:21.894671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c57af-e1b5-4422-ab10-93195cd4b108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:21.895556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c57af-e1b5-4422-ab10-93195cd4b108 None admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:21.895835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c57af-e1b5-4422-ab10-93195cd4b108 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:21.896138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c57af-e1b5-4422-ab10-93195cd4b108 None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/4e52a3464d8f4a3fa16a102336a4bbf6/roles/917334e4be884c77a974784c424ccde3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:21.910565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c57af-e1b5-4422-ab10-93195cd4b108 None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=4e52a3464d8f4a3fa16a102336a4bbf6, role_id=917334e4be884c77a974784c424ccde3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:21.912024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c57af-e1b5-4422-ab10-93195cd4b108 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:22.018298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 621/1232] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:53:21 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/4e52a3464d8f4a3fa16a102336a4bbf6/roles/917334e4be884c77a974784c424ccde3 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:53:24.060783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19d80-d0ce-44d9-9cf5-3f354b190b27 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:24.061333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19d80-d0ce-44d9-9cf5-3f354b190b27 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:24.061438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa19d80-d0ce-44d9-9cf5-3f354b190b27 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:24.062867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 612/1233] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:53:24.068842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66893911-79bf-4706-94b4-2ece46ae698f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:24.069272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66893911-79bf-4706-94b4-2ece46ae698f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:24.069402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66893911-79bf-4706-94b4-2ece46ae698f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:24.085747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-66893911-79bf-4706-94b4-2ece46ae698f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:24.087017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-66893911-79bf-4706-94b4-2ece46ae698f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:24.161944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 622/1234] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:24.186142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa19d80-d0ce-44d9-9cf5-3f354b190b27 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:24.212745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:24.288389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa19d80-d0ce-44d9-9cf5-3f354b190b27 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:24.321897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e812b7-f472-486b-8b77-12f57ea0c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:24.322680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e812b7-f472-486b-8b77-12f57ea0c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:24.322960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e812b7-f472-486b-8b77-12f57ea0c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:24.323236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e812b7-f472-486b-8b77-12f57ea0c5a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:24.333188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e812b7-f472-486b-8b77-12f57ea0c5a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a3e812b7-f472-486b-8b77-12f57ea0c5a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:53:24.340994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:24.342085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:24.343197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 613/1235] 10.222.0.85 () {56 vars in 1102 bytes} [Wed Jul 20 21:53:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:24.349124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66893911-79bf-4706-94b4-2ece46ae698f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:24.394484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:24.446859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66893911-79bf-4706-94b4-2ece46ae698f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:24.480359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53defb-824f-4ea9-8a0d-e33714eddea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:24.481013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53defb-824f-4ea9-8a0d-e33714eddea7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:24.481284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53defb-824f-4ea9-8a0d-e33714eddea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:24.481554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53defb-824f-4ea9-8a0d-e33714eddea7 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:24.482288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53defb-824f-4ea9-8a0d-e33714eddea7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:24.482589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53defb-824f-4ea9-8a0d-e33714eddea7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:24.483954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53defb-824f-4ea9-8a0d-e33714eddea7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:24.492978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 623/1236] 10.222.0.85 () {56 vars in 1103 bytes} [Wed Jul 20 21:53:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:24.498725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e812b7-f472-486b-8b77-12f57ea0c5a5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:24.583492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:24.599381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e812b7-f472-486b-8b77-12f57ea0c5a5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:24.631450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61074662-7650-4d4a-b40f-bcda4e4fcfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:24.632255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61074662-7650-4d4a-b40f-bcda4e4fcfcf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:24.632534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61074662-7650-4d4a-b40f-bcda4e4fcfcf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:24.632810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61074662-7650-4d4a-b40f-bcda4e4fcfcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:24.643713 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61074662-7650-4d4a-b40f-bcda4e4fcfcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:24.645175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61074662-7650-4d4a-b40f-bcda4e4fcfcf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-61074662-7650-4d4a-b40f-bcda4e4fcfcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:24.662445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:24.663579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:24.664566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:24.664566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:24.664566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:24.664566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:24.664566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 614/1237] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:24.669647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53defb-824f-4ea9-8a0d-e33714eddea7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:24.767327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53defb-824f-4ea9-8a0d-e33714eddea7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:24.776883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:24.800662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fc74a-785f-4f21-ad79-fa874a0061f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:24.801312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc74a-785f-4f21-ad79-fa874a0061f4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:24.801589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc74a-785f-4f21-ad79-fa874a0061f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:24.801859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fc74a-785f-4f21-ad79-fa874a0061f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:24.802567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fc74a-785f-4f21-ad79-fa874a0061f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:24.802869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fc74a-785f-4f21-ad79-fa874a0061f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:24.804255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fc74a-785f-4f21-ad79-fa874a0061f4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:24.814983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 624/1238] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:24.820640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61074662-7650-4d4a-b40f-bcda4e4fcfcf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:24.918526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61074662-7650-4d4a-b40f-bcda4e4fcfcf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:24.954013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7b9f0-cc95-42aa-9fe9-f6680d68384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:24.960058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b9f0-cc95-42aa-9fe9-f6680d68384f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:24.960058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b9f0-cc95-42aa-9fe9-f6680d68384f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:24.960058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7b9f0-cc95-42aa-9fe9-f6680d68384f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:24.960058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:24.963814 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7b9f0-cc95-42aa-9fe9-f6680d68384f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:24.965288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb7b9f0-cc95-42aa-9fe9-f6680d68384f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3bb7b9f0-cc95-42aa-9fe9-f6680d68384f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:53:24.979047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:24.980276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:24.981312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 615/1239] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:24.986104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fc74a-785f-4f21-ad79-fa874a0061f4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:25.098817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fc74a-785f-4f21-ad79-fa874a0061f4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:25.131749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02bd6e-bc9f-4b9e-989c-8b403dfa327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:25.132488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02bd6e-bc9f-4b9e-989c-8b403dfa327c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:25.132767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02bd6e-bc9f-4b9e-989c-8b403dfa327c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:25.133039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02bd6e-bc9f-4b9e-989c-8b403dfa327c None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:25.133869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02bd6e-bc9f-4b9e-989c-8b403dfa327c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:25.134179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02bd6e-bc9f-4b9e-989c-8b403dfa327c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:25.135633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02bd6e-bc9f-4b9e-989c-8b403dfa327c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:25.153855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 625/1240] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Jul 20 21:53:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:25.160054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7b9f0-cc95-42aa-9fe9-f6680d68384f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:25.259230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb7b9f0-cc95-42aa-9fe9-f6680d68384f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:25.292491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01267542-ea07-4692-b1c8-cea99c4df565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:25.293128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01267542-ea07-4692-b1c8-cea99c4df565 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:25.293412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01267542-ea07-4692-b1c8-cea99c4df565 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:25.293680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01267542-ea07-4692-b1c8-cea99c4df565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:25.356886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:25.364049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01267542-ea07-4692-b1c8-cea99c4df565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:25.365628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01267542-ea07-4692-b1c8-cea99c4df565 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:25.462931 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 616/1241] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:53:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:53:25.469006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02bd6e-bc9f-4b9e-989c-8b403dfa327c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:25.495985 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:25.570468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02bd6e-bc9f-4b9e-989c-8b403dfa327c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:25.604364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5398ff-03ad-46f4-8552-50eeac68acf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:25.605146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5398ff-03ad-46f4-8552-50eeac68acf7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:25.605429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5398ff-03ad-46f4-8552-50eeac68acf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:25.605704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5398ff-03ad-46f4-8552-50eeac68acf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:25.616204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5398ff-03ad-46f4-8552-50eeac68acf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:25.617579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5398ff-03ad-46f4-8552-50eeac68acf7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-fe5398ff-03ad-46f4-8552-50eeac68acf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:25.636026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:25.637081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:25.638231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:25.638231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:25.638231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:25.638231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:25.638231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 626/1242] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:53:25.643477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01267542-ea07-4692-b1c8-cea99c4df565 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:25.734513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:25.740814 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01267542-ea07-4692-b1c8-cea99c4df565 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:25.774489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df01b90-8520-4ae9-9b23-1c62a3004d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:25.775133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01b90-8520-4ae9-9b23-1c62a3004d6b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:25.775409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01b90-8520-4ae9-9b23-1c62a3004d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:25.775679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df01b90-8520-4ae9-9b23-1c62a3004d6b None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:25.776453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df01b90-8520-4ae9-9b23-1c62a3004d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:25.776758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df01b90-8520-4ae9-9b23-1c62a3004d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:25.778107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df01b90-8520-4ae9-9b23-1c62a3004d6b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:25.789514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 617/1243] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:25.795369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5398ff-03ad-46f4-8552-50eeac68acf7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:25.875487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:25.896943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5398ff-03ad-46f4-8552-50eeac68acf7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:25.931033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a4d50-376f-4411-b618-d50f76c12d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:25.935885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4d50-376f-4411-b618-d50f76c12d2d None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:25.935885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4d50-376f-4411-b618-d50f76c12d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:25.935885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a4d50-376f-4411-b618-d50f76c12d2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:25.938829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a4d50-376f-4411-b618-d50f76c12d2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:25.940502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65a4d50-376f-4411-b618-d50f76c12d2d None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f65a4d50-376f-4411-b618-d50f76c12d2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:53:25.956606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:25.957688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:25.964817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:53:25.964817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:53:25.964817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:53:25.964817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:53:25.964817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:53:25.964817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:53:25.964817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:25.964817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:25.964817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 627/1244] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:25.965468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df01b90-8520-4ae9-9b23-1c62a3004d6b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:26.064136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df01b90-8520-4ae9-9b23-1c62a3004d6b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:26.097302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727091b8-b534-449a-b74b-2d6056b54452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:26.098014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727091b8-b534-449a-b74b-2d6056b54452 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:26.098292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727091b8-b534-449a-b74b-2d6056b54452 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:26.098563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727091b8-b534-449a-b74b-2d6056b54452 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:26.099338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727091b8-b534-449a-b74b-2d6056b54452 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:26.099639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727091b8-b534-449a-b74b-2d6056b54452 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:26.101081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727091b8-b534-449a-b74b-2d6056b54452 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:26.112748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 618/1245] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:26.118876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a4d50-376f-4411-b618-d50f76c12d2d None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:26.217770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65a4d50-376f-4411-b618-d50f76c12d2d None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:26.250815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354ecd9-6f15-4ed3-b662-725543e5ee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:26.251461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354ecd9-6f15-4ed3-b662-725543e5ee2b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:26.251773 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354ecd9-6f15-4ed3-b662-725543e5ee2b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:26.252082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354ecd9-6f15-4ed3-b662-725543e5ee2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:26.253453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354ecd9-6f15-4ed3-b662-725543e5ee2b None admin] RBAC: Adding query filter params (role.id=917334e4be884c77a974784c424ccde3, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=4e52a3464d8f4a3fa16a102336a4bbf6) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:26.253767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354ecd9-6f15-4ed3-b662-725543e5ee2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:26.255195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8354ecd9-6f15-4ed3-b662-725543e5ee2b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:26.261040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 628/1246] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:53:26 2022] GET /identity/v3/role_assignments?user.id=4e52a3464d8f4a3fa16a102336a4bbf6&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=917334e4be884c77a974784c424ccde3 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:28.348811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441d2d4-a0c8-4a23-9f2c-63a7ebaacad7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:28.349421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441d2d4-a0c8-4a23-9f2c-63a7ebaacad7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:28.349421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8441d2d4-a0c8-4a23-9f2c-63a7ebaacad7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:28.350752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 619/1247] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 21:53:28.356239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979c432-4311-492a-b47b-308c3325322b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:28.356615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979c432-4311-492a-b47b-308c3325322b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:28.356804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c979c432-4311-492a-b47b-308c3325322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:28.362333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:28.374473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c979c432-4311-492a-b47b-308c3325322b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:28.375659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c979c432-4311-492a-b47b-308c3325322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:28.443122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 629/1248] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:28.467116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441d2d4-a0c8-4a23-9f2c-63a7ebaacad7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:28.485351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:28.569010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8441d2d4-a0c8-4a23-9f2c-63a7ebaacad7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:28.602109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e94b3-406a-4761-8ae9-b5ae0ae8567c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:28.602811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e94b3-406a-4761-8ae9-b5ae0ae8567c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:28.603085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e94b3-406a-4761-8ae9-b5ae0ae8567c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:28.603354 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e94b3-406a-4761-8ae9-b5ae0ae8567c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:28.613679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e94b3-406a-4761-8ae9-b5ae0ae8567c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8d8e94b3-406a-4761-8ae9-b5ae0ae8567c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:53:28.621248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:28.628658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:28.630654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 620/1249] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:28.632388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979c432-4311-492a-b47b-308c3325322b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:28.727786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c979c432-4311-492a-b47b-308c3325322b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:28.756968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:28.761678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824ce0d-3202-456c-9882-f192ece201a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:28.762326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824ce0d-3202-456c-9882-f192ece201a7 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:28.762600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824ce0d-3202-456c-9882-f192ece201a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:28.762868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d824ce0d-3202-456c-9882-f192ece201a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:28.763600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824ce0d-3202-456c-9882-f192ece201a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:28.763901 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824ce0d-3202-456c-9882-f192ece201a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:28.765301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d824ce0d-3202-456c-9882-f192ece201a7 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:28.773554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 630/1250] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:28.779296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e94b3-406a-4761-8ae9-b5ae0ae8567c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:28.856954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:28.879940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e94b3-406a-4761-8ae9-b5ae0ae8567c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:28.914304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728cfaf-134d-44eb-9fd6-1a37fdd095ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:28.915087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728cfaf-134d-44eb-9fd6-1a37fdd095ad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:28.915371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728cfaf-134d-44eb-9fd6-1a37fdd095ad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:28.915654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b728cfaf-134d-44eb-9fd6-1a37fdd095ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:28.928303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728cfaf-134d-44eb-9fd6-1a37fdd095ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:28.929753 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b728cfaf-134d-44eb-9fd6-1a37fdd095ad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b728cfaf-134d-44eb-9fd6-1a37fdd095ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:28.946688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:28.947709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:28.949639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:28.949639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:28.949639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:28.949639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:28.949639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 621/1251] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:28.953682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824ce0d-3202-456c-9882-f192ece201a7 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:29.056174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d824ce0d-3202-456c-9882-f192ece201a7 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:29.091717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc612c6-7407-4715-8e96-7ee3c382cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:29.092406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc612c6-7407-4715-8e96-7ee3c382cd19 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:29.092691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc612c6-7407-4715-8e96-7ee3c382cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:29.092967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc612c6-7407-4715-8e96-7ee3c382cd19 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:29.093711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc612c6-7407-4715-8e96-7ee3c382cd19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:29.094018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc612c6-7407-4715-8e96-7ee3c382cd19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:29.095408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc612c6-7407-4715-8e96-7ee3c382cd19 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:29.108559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 631/1252] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:29.114638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728cfaf-134d-44eb-9fd6-1a37fdd095ad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:29.215621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b728cfaf-134d-44eb-9fd6-1a37fdd095ad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:29.241633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:29.250651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f8566-a63d-4676-9126-87a458ff9a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:29.251431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f8566-a63d-4676-9126-87a458ff9a06 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:29.251709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f8566-a63d-4676-9126-87a458ff9a06 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:29.252012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f8566-a63d-4676-9126-87a458ff9a06 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:29.259321 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f8566-a63d-4676-9126-87a458ff9a06 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:29.260841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f8566-a63d-4676-9126-87a458ff9a06 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-954f8566-a63d-4676-9126-87a458ff9a06 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:53:29.275570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:29.276768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:29.278127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 622/1253] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:53:29.282793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc612c6-7407-4715-8e96-7ee3c382cd19 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:29.342274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:29.386861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc612c6-7407-4715-8e96-7ee3c382cd19 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:29.422047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ff6f2-78f5-4b73-86d0-6988ae05f546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:29.422728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ff6f2-78f5-4b73-86d0-6988ae05f546 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:29.423005 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ff6f2-78f5-4b73-86d0-6988ae05f546 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:29.423280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ff6f2-78f5-4b73-86d0-6988ae05f546 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:29.424137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ff6f2-78f5-4b73-86d0-6988ae05f546 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:29.424497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ff6f2-78f5-4b73-86d0-6988ae05f546 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:29.425897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8ff6f2-78f5-4b73-86d0-6988ae05f546 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:29.443643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 632/1254] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Jul 20 21:53:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:29.449475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f8566-a63d-4676-9126-87a458ff9a06 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:29.547292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f8566-a63d-4676-9126-87a458ff9a06 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:29.579527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc428cea-3696-4883-8bac-c77d889a02bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:29.580186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428cea-3696-4883-8bac-c77d889a02bd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:29.580488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428cea-3696-4883-8bac-c77d889a02bd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:29.581324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc428cea-3696-4883-8bac-c77d889a02bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:29.637582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:29.650200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc428cea-3696-4883-8bac-c77d889a02bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:29.651665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc428cea-3696-4883-8bac-c77d889a02bd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:29.744302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 623/1255] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:53:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:53:29.750268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ff6f2-78f5-4b73-86d0-6988ae05f546 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:29.850024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8ff6f2-78f5-4b73-86d0-6988ae05f546 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:29.863615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:29.886013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbd7bd-4282-4432-9ba1-322fb6a9c2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:29.886799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbd7bd-4282-4432-9ba1-322fb6a9c2ec None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:29.887078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbd7bd-4282-4432-9ba1-322fb6a9c2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:29.887356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dbd7bd-4282-4432-9ba1-322fb6a9c2ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:29.899826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbd7bd-4282-4432-9ba1-322fb6a9c2ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:29.900017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dbd7bd-4282-4432-9ba1-322fb6a9c2ec None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-82dbd7bd-4282-4432-9ba1-322fb6a9c2ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:29.917503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:29.918607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:29.919577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:29.919577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:29.919577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:29.919577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:29.919577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 633/1256] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:29.925296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc428cea-3696-4883-8bac-c77d889a02bd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:30.013584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:30.025992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc428cea-3696-4883-8bac-c77d889a02bd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:30.061129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f97ab-f5f1-47f5-82da-362eb9c7ee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:30.061972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f97ab-f5f1-47f5-82da-362eb9c7ee85 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:30.062260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f97ab-f5f1-47f5-82da-362eb9c7ee85 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:30.062540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f97ab-f5f1-47f5-82da-362eb9c7ee85 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:30.063342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f97ab-f5f1-47f5-82da-362eb9c7ee85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:30.063652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f97ab-f5f1-47f5-82da-362eb9c7ee85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:30.065823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f97ab-f5f1-47f5-82da-362eb9c7ee85 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:30.077196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 624/1257] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:30.083618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbd7bd-4282-4432-9ba1-322fb6a9c2ec None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:30.183829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dbd7bd-4282-4432-9ba1-322fb6a9c2ec None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:30.218502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a09f96-b831-491b-8787-5ac74fa164a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:30.219285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a09f96-b831-491b-8787-5ac74fa164a9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:30.219566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a09f96-b831-491b-8787-5ac74fa164a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:30.219839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a09f96-b831-491b-8787-5ac74fa164a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:30.226601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a09f96-b831-491b-8787-5ac74fa164a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:30.228076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a09f96-b831-491b-8787-5ac74fa164a9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f8a09f96-b831-491b-8787-5ac74fa164a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:53:30.242102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:30.243160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:30.244495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:53:30.244495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:53:30.244495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:53:30.244495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:53:30.244495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:53:30.244495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:53:30.244495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:30.244495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:30.244495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 634/1258] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:53:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:30.249448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f97ab-f5f1-47f5-82da-362eb9c7ee85 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:30.354326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f97ab-f5f1-47f5-82da-362eb9c7ee85 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:30.387826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc39b59-19ec-47c1-b535-f13328ed1e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:30.388496 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc39b59-19ec-47c1-b535-f13328ed1e54 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:30.388773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc39b59-19ec-47c1-b535-f13328ed1e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:30.389043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc39b59-19ec-47c1-b535-f13328ed1e54 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:30.389815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc39b59-19ec-47c1-b535-f13328ed1e54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:30.390117 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc39b59-19ec-47c1-b535-f13328ed1e54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:30.391584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc39b59-19ec-47c1-b535-f13328ed1e54 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:30.404383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 625/1259] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:53:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:30.410848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a09f96-b831-491b-8787-5ac74fa164a9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:30.437919 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:30.513051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a09f96-b831-491b-8787-5ac74fa164a9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:30.546605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21b207-2626-4a60-8575-95340049065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:30.547251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b207-2626-4a60-8575-95340049065a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:30.547557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b207-2626-4a60-8575-95340049065a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:30.547830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21b207-2626-4a60-8575-95340049065a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:30.548680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21b207-2626-4a60-8575-95340049065a None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=4e52a3464d8f4a3fa16a102336a4bbf6) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:30.548993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21b207-2626-4a60-8575-95340049065a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:30.551376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b21b207-2626-4a60-8575-95340049065a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:30.556748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 635/1260] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:53:30 2022] GET /identity/v3/role_assignments?user.id=4e52a3464d8f4a3fa16a102336a4bbf6&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:32.621949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407927a-94be-4efa-bbef-a3370cc9c401 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:32.622540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407927a-94be-4efa-bbef-a3370cc9c401 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:32.622540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6407927a-94be-4efa-bbef-a3370cc9c401 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:32.623882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 626/1261] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:53:32.629353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582618a1-6425-46ce-9d67-8b50b18918fa None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:32.629784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582618a1-6425-46ce-9d67-8b50b18918fa None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:32.629908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582618a1-6425-46ce-9d67-8b50b18918fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:32.646891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-582618a1-6425-46ce-9d67-8b50b18918fa None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:32.648175 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-582618a1-6425-46ce-9d67-8b50b18918fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:32.716925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 636/1262] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:32.741486 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407927a-94be-4efa-bbef-a3370cc9c401 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:32.752988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:32.850109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6407927a-94be-4efa-bbef-a3370cc9c401 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:32.886137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932c5a1-e13e-44b2-9435-f89f7633fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:32.886851 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932c5a1-e13e-44b2-9435-f89f7633fb45 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:32.887127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932c5a1-e13e-44b2-9435-f89f7633fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:32.887398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c932c5a1-e13e-44b2-9435-f89f7633fb45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:32.898676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c932c5a1-e13e-44b2-9435-f89f7633fb45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c932c5a1-e13e-44b2-9435-f89f7633fb45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:53:32.906397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:32.909696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:32.910719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 627/1263] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:32.914477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582618a1-6425-46ce-9d67-8b50b18918fa None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:32.933502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:33.015580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582618a1-6425-46ce-9d67-8b50b18918fa None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:33.052604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6f6cf-07fd-46e3-95b6-b58094d2e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:33.053273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6f6cf-07fd-46e3-95b6-b58094d2e3bc None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:33.053556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6f6cf-07fd-46e3-95b6-b58094d2e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:33.053835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd6f6cf-07fd-46e3-95b6-b58094d2e3bc None admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:33.054585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6f6cf-07fd-46e3-95b6-b58094d2e3bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:33.054892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6f6cf-07fd-46e3-95b6-b58094d2e3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:33.056283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd6f6cf-07fd-46e3-95b6-b58094d2e3bc None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:33.064355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 637/1264] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:33.070091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932c5a1-e13e-44b2-9435-f89f7633fb45 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:33.137008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:33.170805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c932c5a1-e13e-44b2-9435-f89f7633fb45 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:33.203810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c5715-bfff-4917-a0fe-3cd6493e4638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:33.204622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c5715-bfff-4917-a0fe-3cd6493e4638 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:33.204906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c5715-bfff-4917-a0fe-3cd6493e4638 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:33.205181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c5715-bfff-4917-a0fe-3cd6493e4638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:33.216740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c5715-bfff-4917-a0fe-3cd6493e4638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:33.218189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c5715-bfff-4917-a0fe-3cd6493e4638 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-052c5715-bfff-4917-a0fe-3cd6493e4638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:33.235525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:33.242533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:33.243650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:33.243650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:33.243650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:33.243650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:33.243650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 628/1265] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:33.244051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6f6cf-07fd-46e3-95b6-b58094d2e3bc None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:33.325170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:33.344177 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd6f6cf-07fd-46e3-95b6-b58094d2e3bc None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:33.376824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c7ee5-d130-43ac-ac26-aaf13bfb05e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:33.378041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7ee5-d130-43ac-ac26-aaf13bfb05e9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:33.378659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7ee5-d130-43ac-ac26-aaf13bfb05e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:33.378758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c7ee5-d130-43ac-ac26-aaf13bfb05e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:33.379473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c7ee5-d130-43ac-ac26-aaf13bfb05e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:33.379781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c7ee5-d130-43ac-ac26-aaf13bfb05e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:33.381196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c7ee5-d130-43ac-ac26-aaf13bfb05e9 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:33.394133 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 638/1266] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:33.399796 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c5715-bfff-4917-a0fe-3cd6493e4638 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:33.498410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c5715-bfff-4917-a0fe-3cd6493e4638 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:33.519129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:33.533432 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0b39-8e1a-40da-a3a9-d7a3ccad352f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:33.534463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0b39-8e1a-40da-a3a9-d7a3ccad352f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:33.534750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0b39-8e1a-40da-a3a9-d7a3ccad352f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:33.535029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d0b39-8e1a-40da-a3a9-d7a3ccad352f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:33.542725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d0b39-8e1a-40da-a3a9-d7a3ccad352f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:33.544191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d0b39-8e1a-40da-a3a9-d7a3ccad352f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-843d0b39-8e1a-40da-a3a9-d7a3ccad352f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:53:33.559174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:33.560360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:33.561351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 629/1267] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:33.566924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c7ee5-d130-43ac-ac26-aaf13bfb05e9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:33.666624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c7ee5-d130-43ac-ac26-aaf13bfb05e9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:33.700967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e434d-d038-4524-8bfa-78230b6307a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:33.701632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e434d-d038-4524-8bfa-78230b6307a3 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:33.701910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e434d-d038-4524-8bfa-78230b6307a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:33.702180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0e434d-d038-4524-8bfa-78230b6307a3 None admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:33.703005 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e434d-d038-4524-8bfa-78230b6307a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:33.703307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e434d-d038-4524-8bfa-78230b6307a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:33.704745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0e434d-d038-4524-8bfa-78230b6307a3 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:33.713464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:33.721699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 639/1268] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Jul 20 21:53:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:33.728222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0b39-8e1a-40da-a3a9-d7a3ccad352f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:33.829528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d0b39-8e1a-40da-a3a9-d7a3ccad352f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:33.861779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7fad6-b6af-4001-b89a-aad01c0126c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:33.863115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7fad6-b6af-4001-b89a-aad01c0126c6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:33.863387 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7fad6-b6af-4001-b89a-aad01c0126c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:33.863657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7fad6-b6af-4001-b89a-aad01c0126c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:33.874694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7fad6-b6af-4001-b89a-aad01c0126c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:33.876163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c7fad6-b6af-4001-b89a-aad01c0126c6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-75c7fad6-b6af-4001-b89a-aad01c0126c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:33.893788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:33.900973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:33.902106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:33.902106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:33.902106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:33.902106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:33.902106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 630/1269] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:33.902454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e434d-d038-4524-8bfa-78230b6307a3 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:33.999620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0e434d-d038-4524-8bfa-78230b6307a3 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:34.032989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac7b6d-6e06-4e1c-9528-a21235a5caee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:34.033640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac7b6d-6e06-4e1c-9528-a21235a5caee None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:34.034486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac7b6d-6e06-4e1c-9528-a21235a5caee None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:34.034762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac7b6d-6e06-4e1c-9528-a21235a5caee None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:34.035475 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac7b6d-6e06-4e1c-9528-a21235a5caee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:34.035779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac7b6d-6e06-4e1c-9528-a21235a5caee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:34.037173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac7b6d-6e06-4e1c-9528-a21235a5caee None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:34.048085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 640/1270] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:34.054423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7fad6-b6af-4001-b89a-aad01c0126c6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:34.085447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:34.153344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c7fad6-b6af-4001-b89a-aad01c0126c6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:34.186102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0cde-df61-45ae-8818-0062c7da36ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:34.186877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0cde-df61-45ae-8818-0062c7da36ef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:34.187154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0cde-df61-45ae-8818-0062c7da36ef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:34.187446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637b0cde-df61-45ae-8818-0062c7da36ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:34.194037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0cde-df61-45ae-8818-0062c7da36ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:34.198446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637b0cde-df61-45ae-8818-0062c7da36ef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-637b0cde-df61-45ae-8818-0062c7da36ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:53:34.209193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:34.210373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:34.211680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:53:34.211680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:53:34.211680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:53:34.211680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:53:34.211680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:53:34.211680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:53:34.211680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:34.211680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:34.211680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 631/1271] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:34.216403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac7b6d-6e06-4e1c-9528-a21235a5caee None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:34.276364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:34.320437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac7b6d-6e06-4e1c-9528-a21235a5caee None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:34.353216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9840d8b-84b3-48b2-8f72-0936a752b24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:34.353861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840d8b-84b3-48b2-8f72-0936a752b24a None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:34.354136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840d8b-84b3-48b2-8f72-0936a752b24a None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:34.354406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9840d8b-84b3-48b2-8f72-0936a752b24a None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:34.355176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9840d8b-84b3-48b2-8f72-0936a752b24a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:34.355475 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9840d8b-84b3-48b2-8f72-0936a752b24a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:34.356934 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9840d8b-84b3-48b2-8f72-0936a752b24a None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:34.369025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 641/1272] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:53:34.376230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0cde-df61-45ae-8818-0062c7da36ef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:34.469088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:34.478286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637b0cde-df61-45ae-8818-0062c7da36ef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:34.512241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d77430c-1684-4a0e-ac13-1ccc6e4acf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:34.513259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77430c-1684-4a0e-ac13-1ccc6e4acf4b None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:34.513495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77430c-1684-4a0e-ac13-1ccc6e4acf4b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:34.513772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d77430c-1684-4a0e-ac13-1ccc6e4acf4b None admin] PATH_INFO: `/v3/projects/72c7456d6a30482f975028cab1d346f6/users/4e52a3464d8f4a3fa16a102336a4bbf6/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:34.515737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77430c-1684-4a0e-ac13-1ccc6e4acf4b None admin] RBAC: Authorizing `identity:create_grant(project_id=72c7456d6a30482f975028cab1d346f6, user_id=4e52a3464d8f4a3fa16a102336a4bbf6, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:34.517460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d77430c-1684-4a0e-ac13-1ccc6e4acf4b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:34.601181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 632/1273] 10.222.0.85 () {58 vars in 1439 bytes} [Wed Jul 20 21:53:34 2022] PUT /identity/v3/projects/72c7456d6a30482f975028cab1d346f6/users/4e52a3464d8f4a3fa16a102336a4bbf6/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 21:53:36.667834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ffe77-b6bc-4497-a471-a9ee08870ba5 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:36.668394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ffe77-b6bc-4497-a471-a9ee08870ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:36.668394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517ffe77-b6bc-4497-a471-a9ee08870ba5 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:36.669819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 642/1274] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:53:36.675187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd843934-f3ed-4765-9844-851aedc1d6ca None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:36.675626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd843934-f3ed-4765-9844-851aedc1d6ca None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:36.675726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd843934-f3ed-4765-9844-851aedc1d6ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:36.692102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dd843934-f3ed-4765-9844-851aedc1d6ca None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:36.694854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dd843934-f3ed-4765-9844-851aedc1d6ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:36.761362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 633/1275] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:36.787862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ffe77-b6bc-4497-a471-a9ee08870ba5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:36.889508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517ffe77-b6bc-4497-a471-a9ee08870ba5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:36.907087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:36.923971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b679620-b263-4f49-a9ed-77c83c29c9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:36.925210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679620-b263-4f49-a9ed-77c83c29c9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:36.925494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679620-b263-4f49-a9ed-77c83c29c9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:36.925770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b679620-b263-4f49-a9ed-77c83c29c9d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:36.935764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b679620-b263-4f49-a9ed-77c83c29c9d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2b679620-b263-4f49-a9ed-77c83c29c9d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 20 21:53:36.944539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:36.951162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:36.952733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 643/1276] 10.222.0.85 () {56 vars in 1096 bytes} [Wed Jul 20 21:53:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:36.953590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd843934-f3ed-4765-9844-851aedc1d6ca None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:37.035654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:37.053539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd843934-f3ed-4765-9844-851aedc1d6ca None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:37.088384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33968f89-1818-4fc9-91d1-bb1dc062c34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:37.089050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33968f89-1818-4fc9-91d1-bb1dc062c34f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:37.089333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33968f89-1818-4fc9-91d1-bb1dc062c34f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:37.089609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33968f89-1818-4fc9-91d1-bb1dc062c34f None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:37.090364 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33968f89-1818-4fc9-91d1-bb1dc062c34f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:37.090673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33968f89-1818-4fc9-91d1-bb1dc062c34f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:37.092072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33968f89-1818-4fc9-91d1-bb1dc062c34f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:37.100242 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 634/1277] 10.222.0.85 () {56 vars in 1099 bytes} [Wed Jul 20 21:53:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:37.106116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b679620-b263-4f49-a9ed-77c83c29c9d9 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:37.205407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b679620-b263-4f49-a9ed-77c83c29c9d9 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:37.239486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907c934-f756-4461-8270-af91e4aa23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:37.240296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907c934-f756-4461-8270-af91e4aa23a4 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:37.240580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907c934-f756-4461-8270-af91e4aa23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:37.240873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907c934-f756-4461-8270-af91e4aa23a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:37.251499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907c934-f756-4461-8270-af91e4aa23a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:37.253465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907c934-f756-4461-8270-af91e4aa23a4 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-2907c934-f756-4461-8270-af91e4aa23a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:37.271848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:37.272915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:37.274036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:37.274036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:37.274036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:37.274036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:37.274036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 644/1278] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:37.279174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33968f89-1818-4fc9-91d1-bb1dc062c34f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:37.379341 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33968f89-1818-4fc9-91d1-bb1dc062c34f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:37.414484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3123739-0a98-4104-bb0a-653e461e39f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:37.415132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3123739-0a98-4104-bb0a-653e461e39f8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:37.415413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3123739-0a98-4104-bb0a-653e461e39f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:37.415685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3123739-0a98-4104-bb0a-653e461e39f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:37.416685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3123739-0a98-4104-bb0a-653e461e39f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:37.416827 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3123739-0a98-4104-bb0a-653e461e39f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:37.418106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3123739-0a98-4104-bb0a-653e461e39f8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:37.430725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 635/1279] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:37.436445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907c934-f756-4461-8270-af91e4aa23a4 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:37.467421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:37.537221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907c934-f756-4461-8270-af91e4aa23a4 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:37.572225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9917e5-92d5-404e-848c-78866e05d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:37.573069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9917e5-92d5-404e-848c-78866e05d43c None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:37.573356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9917e5-92d5-404e-848c-78866e05d43c None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:37.573635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9917e5-92d5-404e-848c-78866e05d43c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:37.581228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9917e5-92d5-404e-848c-78866e05d43c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:37.582837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9917e5-92d5-404e-848c-78866e05d43c None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-fa9917e5-92d5-404e-848c-78866e05d43c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 20 21:53:37.597978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:37.599170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:37.600329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 645/1280] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:37.605292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3123739-0a98-4104-bb0a-653e461e39f8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:37.609263 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:37.709559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3123739-0a98-4104-bb0a-653e461e39f8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:37.744494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdeb31f-38a9-4a20-a451-db1c9645862e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:37.745292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeb31f-38a9-4a20-a451-db1c9645862e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:37.745585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeb31f-38a9-4a20-a451-db1c9645862e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:37.745862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdeb31f-38a9-4a20-a451-db1c9645862e None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:37.746701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdeb31f-38a9-4a20-a451-db1c9645862e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:37.747004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdeb31f-38a9-4a20-a451-db1c9645862e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:37.748471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdeb31f-38a9-4a20-a451-db1c9645862e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:37.765732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 636/1281] 10.222.0.85 () {56 vars in 1143 bytes} [Wed Jul 20 21:53:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:37.772198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9917e5-92d5-404e-848c-78866e05d43c None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:37.867775 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:37.877055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9917e5-92d5-404e-848c-78866e05d43c None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:37.909606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6c375-df21-4f23-b92d-5e1db242ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:37.910243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6c375-df21-4f23-b92d-5e1db242ff3b None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:37.910525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6c375-df21-4f23-b92d-5e1db242ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:37.910798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6c375-df21-4f23-b92d-5e1db242ff3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:37.979810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6c375-df21-4f23-b92d-5e1db242ff3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:37.981292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6c375-df21-4f23-b92d-5e1db242ff3b None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:38.069468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:38.079125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 646/1282] 10.222.0.85 () {58 vars in 1282 bytes} [Wed Jul 20 21:53:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 20 21:53:38.085691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdeb31f-38a9-4a20-a451-db1c9645862e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:38.148220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:38.186183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdeb31f-38a9-4a20-a451-db1c9645862e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:38.221380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a5451-589e-4912-bc62-aa5f78ff9ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:38.222920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5451-589e-4912-bc62-aa5f78ff9ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:38.223202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5451-589e-4912-bc62-aa5f78ff9ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:38.223475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a5451-589e-4912-bc62-aa5f78ff9ce7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:38.233198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a5451-589e-4912-bc62-aa5f78ff9ce7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:38.234637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a5451-589e-4912-bc62-aa5f78ff9ce7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f94a5451-589e-4912-bc62-aa5f78ff9ce7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 20 21:53:38.251411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:38.261298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:38.262462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 20 21:53:38.262462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 20 21:53:38.262462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 20 21:53:38.262462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:38.262462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 637/1283] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 21:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 20 21:53:38.262820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6c375-df21-4f23-b92d-5e1db242ff3b None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:38.364008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6c375-df21-4f23-b92d-5e1db242ff3b None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:38.399740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798feca3-e452-4ad0-9b26-f81a4cd1ba72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:38.400442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798feca3-e452-4ad0-9b26-f81a4cd1ba72 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:38.400727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798feca3-e452-4ad0-9b26-f81a4cd1ba72 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:38.401003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798feca3-e452-4ad0-9b26-f81a4cd1ba72 None admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:38.401727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798feca3-e452-4ad0-9b26-f81a4cd1ba72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:38.402034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798feca3-e452-4ad0-9b26-f81a4cd1ba72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:38.403395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798feca3-e452-4ad0-9b26-f81a4cd1ba72 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:38.415297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 647/1284] 10.222.0.85 () {56 vars in 1109 bytes} [Wed Jul 20 21:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:38.421271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a5451-589e-4912-bc62-aa5f78ff9ce7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:38.523267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a5451-589e-4912-bc62-aa5f78ff9ce7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:38.537476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:38.557358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0f779-efd3-4218-b54a-fd38fa35d7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:38.558153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f779-efd3-4218-b54a-fd38fa35d7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:38.558435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f779-efd3-4218-b54a-fd38fa35d7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:38.558706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0f779-efd3-4218-b54a-fd38fa35d7b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:38.565997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0f779-efd3-4218-b54a-fd38fa35d7b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:38.567442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0f779-efd3-4218-b54a-fd38fa35d7b0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5bc0f779-efd3-4218-b54a-fd38fa35d7b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 20 21:53:38.582024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:38.583697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:38.585495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 20 21:53:38.585495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 20 21:53:38.585495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 20 21:53:38.585495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 20 21:53:38.585495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 20 21:53:38.585495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 20 21:53:38.585495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 20 21:53:38.585495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Jul 20 21:53:38.585495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 638/1285] 10.222.0.85 () {56 vars in 1111 bytes} [Wed Jul 20 21:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:38.589104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798feca3-e452-4ad0-9b26-f81a4cd1ba72 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:38.638984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:38.688067 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798feca3-e452-4ad0-9b26-f81a4cd1ba72 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:38.721843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a21920-ab36-4e38-9e50-9b8eeedc2867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:38.722489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a21920-ab36-4e38-9e50-9b8eeedc2867 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:38.722769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a21920-ab36-4e38-9e50-9b8eeedc2867 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:38.723042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a21920-ab36-4e38-9e50-9b8eeedc2867 None admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:38.723822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a21920-ab36-4e38-9e50-9b8eeedc2867 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:38.724154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a21920-ab36-4e38-9e50-9b8eeedc2867 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:38.725690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a21920-ab36-4e38-9e50-9b8eeedc2867 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:38.737501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 648/1286] 10.222.0.85 () {56 vars in 1148 bytes} [Wed Jul 20 21:53:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 21:53:38.743584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0f779-efd3-4218-b54a-fd38fa35d7b0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:38.845751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0f779-efd3-4218-b54a-fd38fa35d7b0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:38.881022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1422403d-ae97-4357-91eb-d3ec6a084b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:38.881670 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422403d-ae97-4357-91eb-d3ec6a084b74 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:38.881954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422403d-ae97-4357-91eb-d3ec6a084b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:38.882233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1422403d-ae97-4357-91eb-d3ec6a084b74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:38.883054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422403d-ae97-4357-91eb-d3ec6a084b74 None admin] RBAC: Adding query filter params (role.id=01b5cc9fdaf942efb958189754cd6a9e, scope.project.id=72c7456d6a30482f975028cab1d346f6, user.id=4e52a3464d8f4a3fa16a102336a4bbf6) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:38.883366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422403d-ae97-4357-91eb-d3ec6a084b74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:38.884881 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1422403d-ae97-4357-91eb-d3ec6a084b74 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:38.890800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 639/1287] 10.222.0.85 () {56 vars in 1374 bytes} [Wed Jul 20 21:53:38 2022] GET /identity/v3/role_assignments?user.id=4e52a3464d8f4a3fa16a102336a4bbf6&scope.project.id=72c7456d6a30482f975028cab1d346f6&role.id=01b5cc9fdaf942efb958189754cd6a9e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:40.997287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648c400-b824-472c-a8e6-fab1ce86ec50 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:40.997799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648c400-b824-472c-a8e6-fab1ce86ec50 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:40.997892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e648c400-b824-472c-a8e6-fab1ce86ec50 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:40.999207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 649/1288] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:53:41.004659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dbab0-3614-4421-abe6-2683df12835f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:41.010776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dbab0-3614-4421-abe6-2683df12835f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:41.010776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5dbab0-3614-4421-abe6-2683df12835f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:41.022981 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fa5dbab0-3614-4421-abe6-2683df12835f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:41.024217 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fa5dbab0-3614-4421-abe6-2683df12835f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:41.054401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:41.091481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 640/1289] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:41.115424 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648c400-b824-472c-a8e6-fab1ce86ec50 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:41.217976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e648c400-b824-472c-a8e6-fab1ce86ec50 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:41.229402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:41.252039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed34b56-72cf-4b2c-a525-72b4116cc98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:41.252826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed34b56-72cf-4b2c-a525-72b4116cc98f None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:41.253104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed34b56-72cf-4b2c-a525-72b4116cc98f None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:41.253392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed34b56-72cf-4b2c-a525-72b4116cc98f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:41.254035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed34b56-72cf-4b2c-a525-72b4116cc98f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:41.255385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed34b56-72cf-4b2c-a525-72b4116cc98f None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-5ed34b56-72cf-4b2c-a525-72b4116cc98f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:41.267088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:41.268578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:41.269698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 650/1290] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Jul 20 21:53:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:41.275774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dbab0-3614-4421-abe6-2683df12835f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:41.375354 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5dbab0-3614-4421-abe6-2683df12835f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:41.409818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369d500-a546-4d3e-97a8-942619b65107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:41.410471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369d500-a546-4d3e-97a8-942619b65107 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:41.410749 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369d500-a546-4d3e-97a8-942619b65107 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:41.411064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369d500-a546-4d3e-97a8-942619b65107 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:41.411847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369d500-a546-4d3e-97a8-942619b65107 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:41.412181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369d500-a546-4d3e-97a8-942619b65107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:41.413537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369d500-a546-4d3e-97a8-942619b65107 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:41.418319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 641/1291] 10.222.0.85 () {56 vars in 1116 bytes} [Wed Jul 20 21:53:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:41.424610 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed34b56-72cf-4b2c-a525-72b4116cc98f None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:41.527058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed34b56-72cf-4b2c-a525-72b4116cc98f None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:41.560787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c52686c-e222-41ed-8181-bca1e2f8f977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:41.561438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52686c-e222-41ed-8181-bca1e2f8f977 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:41.561720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52686c-e222-41ed-8181-bca1e2f8f977 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:41.561996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c52686c-e222-41ed-8181-bca1e2f8f977 None admin] PATH_INFO: `/v3/services` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:41.562695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52686c-e222-41ed-8181-bca1e2f8f977 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:41.562999 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52686c-e222-41ed-8181-bca1e2f8f977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:41.564389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c52686c-e222-41ed-8181-bca1e2f8f977 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:41.569523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 651/1292] 10.222.0.85 () {56 vars in 1116 bytes} [Wed Jul 20 21:53:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:43.592010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a36afe-1e12-4e8d-9fe7-a6be2ecf6097 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:43.592681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a36afe-1e12-4e8d-9fe7-a6be2ecf6097 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:43.592681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a36afe-1e12-4e8d-9fe7-a6be2ecf6097 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:43.593920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 642/1293] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:53:43.599477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d102fe-a88a-420a-b266-3a576398d65d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:43.599881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d102fe-a88a-420a-b266-3a576398d65d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:43.600099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d102fe-a88a-420a-b266-3a576398d65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:43.618460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b5d102fe-a88a-420a-b266-3a576398d65d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:43.621169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b5d102fe-a88a-420a-b266-3a576398d65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:43.650764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:43.687209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 652/1294] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:43.710668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a36afe-1e12-4e8d-9fe7-a6be2ecf6097 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:43.743079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:43.812334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a36afe-1e12-4e8d-9fe7-a6be2ecf6097 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:43.847114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04e15f-d086-48c3-94ef-65bbd397b742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:43.847821 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04e15f-d086-48c3-94ef-65bbd397b742 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:43.848132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04e15f-d086-48c3-94ef-65bbd397b742 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:43.848409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04e15f-d086-48c3-94ef-65bbd397b742 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:43.849135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04e15f-d086-48c3-94ef-65bbd397b742 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:43.850500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04e15f-d086-48c3-94ef-65bbd397b742 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:43.956417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 643/1295] 10.222.0.85 () {60 vars in 1141 bytes} [Wed Jul 20 21:53:43 2022] POST /identity/v3/services => generated 246 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:53:46.070555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd04a1e-db96-4b5a-a827-b19f1c5d29d3 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:46.071095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd04a1e-db96-4b5a-a827-b19f1c5d29d3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:46.071095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd04a1e-db96-4b5a-a827-b19f1c5d29d3 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:46.072511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 653/1296] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:53:46.077951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66692a7b-2a6c-4891-ae70-f02301c9bf9f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:46.078374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66692a7b-2a6c-4891-ae70-f02301c9bf9f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:46.078488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66692a7b-2a6c-4891-ae70-f02301c9bf9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:46.095997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-66692a7b-2a6c-4891-ae70-f02301c9bf9f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:46.097232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-66692a7b-2a6c-4891-ae70-f02301c9bf9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:46.169225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 644/1297] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:46.192268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd04a1e-db96-4b5a-a827-b19f1c5d29d3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:46.292253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd04a1e-db96-4b5a-a827-b19f1c5d29d3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:46.327199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f03483-51c6-4f0b-80eb-5713079c84f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:46.328008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03483-51c6-4f0b-80eb-5713079c84f2 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:46.328290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03483-51c6-4f0b-80eb-5713079c84f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:46.328561 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f03483-51c6-4f0b-80eb-5713079c84f2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:46.329208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f03483-51c6-4f0b-80eb-5713079c84f2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:46.330568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f03483-51c6-4f0b-80eb-5713079c84f2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-f3f03483-51c6-4f0b-80eb-5713079c84f2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:46.342930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:46.344125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:46.345024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 654/1298] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Jul 20 21:53:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:46.350542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66692a7b-2a6c-4891-ae70-f02301c9bf9f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:46.369660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:46.450920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66692a7b-2a6c-4891-ae70-f02301c9bf9f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:46.485090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9422233-e5ab-4ff5-8ea1-bc4537b2f8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:46.485754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9422233-e5ab-4ff5-8ea1-bc4537b2f8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:46.486038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9422233-e5ab-4ff5-8ea1-bc4537b2f8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:46.486316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9422233-e5ab-4ff5-8ea1-bc4537b2f8a2 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:46.487562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9422233-e5ab-4ff5-8ea1-bc4537b2f8a2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:46.487870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9422233-e5ab-4ff5-8ea1-bc4537b2f8a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:46.489332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9422233-e5ab-4ff5-8ea1-bc4537b2f8a2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:46.495512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 645/1299] 10.222.0.85 () {56 vars in 1116 bytes} [Wed Jul 20 21:53:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:46.501525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f03483-51c6-4f0b-80eb-5713079c84f2 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:46.533732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:46.601445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f03483-51c6-4f0b-80eb-5713079c84f2 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:46.637908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd725e-f298-4526-b730-82672298b302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:46.638566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd725e-f298-4526-b730-82672298b302 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:46.638852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd725e-f298-4526-b730-82672298b302 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:46.639123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd725e-f298-4526-b730-82672298b302 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:46.639908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd725e-f298-4526-b730-82672298b302 None admin] RBAC: Adding query filter params (interface=public, service_id=88bdfba577564039a760394236b48014, region_id=RegionOne) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:46.640245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd725e-f298-4526-b730-82672298b302 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:46.641608 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd725e-f298-4526-b730-82672298b302 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:46.647271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 655/1300] 10.222.0.85 () {56 vars in 1251 bytes} [Wed Jul 20 21:53:46 2022] GET /identity/v3/endpoints?service_id=88bdfba577564039a760394236b48014&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:46.653386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9422233-e5ab-4ff5-8ea1-bc4537b2f8a2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:46.736460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:46.755861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9422233-e5ab-4ff5-8ea1-bc4537b2f8a2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:46.790378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1857e2-77ea-4ce2-a0b4-65470acf4a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:46.791038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1857e2-77ea-4ce2-a0b4-65470acf4a70 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:46.791319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1857e2-77ea-4ce2-a0b4-65470acf4a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:46.791615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1857e2-77ea-4ce2-a0b4-65470acf4a70 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:46.792331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1857e2-77ea-4ce2-a0b4-65470acf4a70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:46.793712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1857e2-77ea-4ce2-a0b4-65470acf4a70 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:46.801363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 646/1301] 10.222.0.85 () {56 vars in 1087 bytes} [Wed Jul 20 21:53:46 2022] GET /identity/v3/services => generated 2191 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 21:53:48.918662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa335d20-24d6-4528-86b7-34cf6e1f5992 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:48.919219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa335d20-24d6-4528-86b7-34cf6e1f5992 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:48.919317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa335d20-24d6-4528-86b7-34cf6e1f5992 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:48.920702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 656/1302] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 21:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 21:53:48.926738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c52d-39de-4e28-bc47-b533deea5290 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:48.927170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c52d-39de-4e28-bc47-b533deea5290 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:48.927288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699c52d-39de-4e28-bc47-b533deea5290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:48.944115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f699c52d-39de-4e28-bc47-b533deea5290 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 21:53:48.945320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f699c52d-39de-4e28-bc47-b533deea5290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 21:53:49.013421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 647/1303] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 21:53:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 20 21:53:49.036744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa335d20-24d6-4528-86b7-34cf6e1f5992 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:49.133564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:49.140257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa335d20-24d6-4528-86b7-34cf6e1f5992 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:49.177419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23862e1-33ea-4426-a944-52a0cb8b0116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:49.177419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23862e1-33ea-4426-a944-52a0cb8b0116 None admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:49.177419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23862e1-33ea-4426-a944-52a0cb8b0116 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:49.177419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23862e1-33ea-4426-a944-52a0cb8b0116 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:49.177852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23862e1-33ea-4426-a944-52a0cb8b0116 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:49.178372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23862e1-33ea-4426-a944-52a0cb8b0116 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application [None req-e23862e1-33ea-4426-a944-52a0cb8b0116 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 20 21:53:49.190022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 20 21:53:49.191234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.get_or_create( Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application with Lock( Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self._enter() Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application return self.creator() Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application created_value = creator( Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: ERROR keystone.server.flask.application Jul 20 21:53:49.192171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 657/1304] 10.222.0.85 () {56 vars in 1117 bytes} [Wed Jul 20 21:53:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 20 21:53:49.197482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699c52d-39de-4e28-bc47-b533deea5290 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:49.272850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:49.294867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699c52d-39de-4e28-bc47-b533deea5290 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:49.327375 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884c4d09-053b-4ecd-9cde-a1ebc4cf9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:49.328061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4d09-053b-4ecd-9cde-a1ebc4cf9842 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:49.328344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4d09-053b-4ecd-9cde-a1ebc4cf9842 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:49.328617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884c4d09-053b-4ecd-9cde-a1ebc4cf9842 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:49.329319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c4d09-053b-4ecd-9cde-a1ebc4cf9842 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 21:53:49.329630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c4d09-053b-4ecd-9cde-a1ebc4cf9842 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:49.331522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884c4d09-053b-4ecd-9cde-a1ebc4cf9842 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:49.336747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 648/1305] 10.222.0.85 () {56 vars in 1116 bytes} [Wed Jul 20 21:53:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 21:53:49.342565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23862e1-33ea-4426-a944-52a0cb8b0116 None admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 21:53:49.443343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23862e1-33ea-4426-a944-52a0cb8b0116 None admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 21:53:49.479098 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ddf61-299b-4e05-ad01-4f2d3ff113d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 21:53:49.479832 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ddf61-299b-4e05-ad01-4f2d3ff113d2 None admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 21:53:49.480148 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ddf61-299b-4e05-ad01-4f2d3ff113d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 21:53:49.480451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ddf61-299b-4e05-ad01-4f2d3ff113d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 21:53:49.481205 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ddf61-299b-4e05-ad01-4f2d3ff113d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 21:53:49.482584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ddf61-299b-4e05-ad01-4f2d3ff113d2 None admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 21:53:49.596943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 658/1306] 10.222.0.85 () {60 vars in 1144 bytes} [Wed Jul 20 21:53:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 21:53:59.376122 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=30 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 21:53:59.591627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:41.207738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27235d-9d42-4ffc-a3f5-2eb794bae397 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:41.208828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27235d-9d42-4ffc-a3f5-2eb794bae397 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:41.209348 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27235d-9d42-4ffc-a3f5-2eb794bae397 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:41.216434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da8025-780c-4d7a-92e6-f0c565767803 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:41.219472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da8025-780c-4d7a-92e6-f0c565767803 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:41.219472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da8025-780c-4d7a-92e6-f0c565767803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:41.220169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 649/1307] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:00:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:00:41.324651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-96da8025-780c-4d7a-92e6-f0c565767803 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:00:41.326242 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-96da8025-780c-4d7a-92e6-f0c565767803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:41.466161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 659/1308] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:00:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:00:41.502415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b9a92-dcc5-4175-b500-fc462f675f54 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:41.503077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b9a92-dcc5-4175-b500-fc462f675f54 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:41.503574 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2b9a92-dcc5-4175-b500-fc462f675f54 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:41.505749 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 650/1309] 10.222.0.85 () {54 vars in 965 bytes} [Wed Jul 20 22:00:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:00:41.518855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de548-ffc0-405a-8aaa-568d0feb3863 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:41.519179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de548-ffc0-405a-8aaa-568d0feb3863 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:41.519423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7de548-ffc0-405a-8aaa-568d0feb3863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:41.645487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6c7de548-ffc0-405a-8aaa-568d0feb3863 None None] MFA Rules not processed for user `2ad07969d5a043e7b83e403da35120da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:00:41.648434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6c7de548-ffc0-405a-8aaa-568d0feb3863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:41.683580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:41.756217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 660/1310] 10.222.0.85 () {58 vars in 1062 bytes} [Wed Jul 20 22:00:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:00:41.764598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b9a92-dcc5-4175-b500-fc462f675f54 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:00:41.767381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ec2b9a92-dcc5-4175-b500-fc462f675f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:41.910034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2b9a92-dcc5-4175-b500-fc462f675f54 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:00:42.002763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb19df-55e1-4b06-9b36-31ef2e7b0a96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:00:42.003422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb19df-55e1-4b06-9b36-31ef2e7b0a96 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:42.003702 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb19df-55e1-4b06-9b36-31ef2e7b0a96 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:42.004003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb19df-55e1-4b06-9b36-31ef2e7b0a96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:42.005703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e8bb19df-55e1-4b06-9b36-31ef2e7b0a96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:42.065497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:42.122286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb19df-55e1-4b06-9b36-31ef2e7b0a96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:00:42.288713 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb19df-55e1-4b06-9b36-31ef2e7b0a96 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:00:42.288713 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 651/1311] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:00:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:00:44.661666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77a2f-4660-4685-a411-7d4315cbb72a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:44.662253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77a2f-4660-4685-a411-7d4315cbb72a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:44.662253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c77a2f-4660-4685-a411-7d4315cbb72a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:44.663741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 661/1312] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:00:44.669133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b892b2a-1bb3-4791-a01c-1b532e5ed4d6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:44.669697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b892b2a-1bb3-4791-a01c-1b532e5ed4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:44.669697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b892b2a-1bb3-4791-a01c-1b532e5ed4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:44.744493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3b892b2a-1bb3-4791-a01c-1b532e5ed4d6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:00:44.745667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3b892b2a-1bb3-4791-a01c-1b532e5ed4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:44.871202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 652/1313] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:00:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:00:44.910835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c77a2f-4660-4685-a411-7d4315cbb72a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:00:44.912640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c4c77a2f-4660-4685-a411-7d4315cbb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:45.035396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c77a2f-4660-4685-a411-7d4315cbb72a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:00:45.121007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:45.123668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7ae9f-f9f5-4316-ad57-c85d06288e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:00:45.124433 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7ae9f-f9f5-4316-ad57-c85d06288e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:45.125208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7ae9f-f9f5-4316-ad57-c85d06288e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:45.125620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7ae9f-f9f5-4316-ad57-c85d06288e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:45.127536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b5c7ae9f-f9f5-4316-ad57-c85d06288e95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:45.241937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7ae9f-f9f5-4316-ad57-c85d06288e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:00:45.243436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7ae9f-f9f5-4316-ad57-c85d06288e95 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:00:45.261918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 662/1314] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:00:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:00:47.891077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93f4c7-a7a6-480a-ab8c-5fcf07f12e48 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:47.891620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93f4c7-a7a6-480a-ab8c-5fcf07f12e48 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:47.891886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc93f4c7-a7a6-480a-ab8c-5fcf07f12e48 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:47.893301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 653/1315] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:00:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:00:47.898465 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c08b02-bbaa-408d-9464-3a92ac99941c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:47.898857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c08b02-bbaa-408d-9464-3a92ac99941c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:47.899021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c08b02-bbaa-408d-9464-3a92ac99941c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:47.963424 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-42c08b02-bbaa-408d-9464-3a92ac99941c None None] MFA Rules not processed for user `77833c08172c4aa2bc9b92c7124c3fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:00:47.964664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-42c08b02-bbaa-408d-9464-3a92ac99941c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:48.016771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:48.060673 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 663/1316] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:00:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:00:48.117512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06e4b5-cf3d-44a0-822e-d38acac8c3a3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:48.117795 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06e4b5-cf3d-44a0-822e-d38acac8c3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:48.118072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06e4b5-cf3d-44a0-822e-d38acac8c3a3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:48.119459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 654/1317] 10.222.0.85 () {54 vars in 965 bytes} [Wed Jul 20 22:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:00:48.126498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9ec31-55e5-45ee-89c1-5d38dadcdb73 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:48.126784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9ec31-55e5-45ee-89c1-5d38dadcdb73 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:48.127062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd9ec31-55e5-45ee-89c1-5d38dadcdb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:48.204107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5bd9ec31-55e5-45ee-89c1-5d38dadcdb73 None None] MFA Rules not processed for user `2ad07969d5a043e7b83e403da35120da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:00:48.205236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5bd9ec31-55e5-45ee-89c1-5d38dadcdb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:48.280136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 664/1318] 10.222.0.85 () {58 vars in 1062 bytes} [Wed Jul 20 22:00:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:00:48.289172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06e4b5-cf3d-44a0-822e-d38acac8c3a3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:00:48.290712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1c06e4b5-cf3d-44a0-822e-d38acac8c3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:48.300689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:48.394824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06e4b5-cf3d-44a0-822e-d38acac8c3a3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:00:48.469121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087c9b9-b634-4402-8c94-004fd8fb3b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:00:48.469716 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087c9b9-b634-4402-8c94-004fd8fb3b63 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:48.469999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087c9b9-b634-4402-8c94-004fd8fb3b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:48.470271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087c9b9-b634-4402-8c94-004fd8fb3b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:48.471962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3087c9b9-b634-4402-8c94-004fd8fb3b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:48.534135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:48.580768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087c9b9-b634-4402-8c94-004fd8fb3b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:00:48.582219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087c9b9-b634-4402-8c94-004fd8fb3b63 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:00:48.600668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 655/1319] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:00:48 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:00:51.927535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6bfa6-7667-43fa-a4f2-c9e528eea7ff None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:51.928094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6bfa6-7667-43fa-a4f2-c9e528eea7ff None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:51.928094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa6bfa6-7667-43fa-a4f2-c9e528eea7ff None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:51.929482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 665/1320] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:00:51.934775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead429e4-7112-4580-8f86-e28ca7be0c33 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:51.935225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead429e4-7112-4580-8f86-e28ca7be0c33 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:51.935321 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead429e4-7112-4580-8f86-e28ca7be0c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:52.000639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ead429e4-7112-4580-8f86-e28ca7be0c33 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:00:52.001882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ead429e4-7112-4580-8f86-e28ca7be0c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:52.098669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 656/1321] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:00:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:00:52.139247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6bfa6-7667-43fa-a4f2-c9e528eea7ff None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:00:52.141349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7aa6bfa6-7667-43fa-a4f2-c9e528eea7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:52.194068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:52.248050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa6bfa6-7667-43fa-a4f2-c9e528eea7ff None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:00:52.323763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34021acf-e1e6-4f64-bfc3-16f60bdd5906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:00:52.324429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021acf-e1e6-4f64-bfc3-16f60bdd5906 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:52.324711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021acf-e1e6-4f64-bfc3-16f60bdd5906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:52.324983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34021acf-e1e6-4f64-bfc3-16f60bdd5906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:52.326620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-34021acf-e1e6-4f64-bfc3-16f60bdd5906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:52.420694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:52.434271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34021acf-e1e6-4f64-bfc3-16f60bdd5906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:00:52.435717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34021acf-e1e6-4f64-bfc3-16f60bdd5906 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:00:52.455278 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 666/1322] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:00:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:00:55.869579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7525-1242-4822-8478-28c97aedbf77 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:55.870155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7525-1242-4822-8478-28c97aedbf77 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:55.870292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b7525-1242-4822-8478-28c97aedbf77 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:55.871622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 657/1323] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:00:55.877320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1981-9837-4544-a9e4-f50d263601a7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:55.877741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1981-9837-4544-a9e4-f50d263601a7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:55.877872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd1981-9837-4544-a9e4-f50d263601a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:55.943655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d3fd1981-9837-4544-a9e4-f50d263601a7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:00:55.944922 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d3fd1981-9837-4544-a9e4-f50d263601a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:56.047319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 667/1324] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:00:56.084319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7525-1242-4822-8478-28c97aedbf77 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:00:56.085862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e2b7525-1242-4822-8478-28c97aedbf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:56.106139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:56.204976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b7525-1242-4822-8478-28c97aedbf77 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:00:56.294402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e0a66-4b21-4583-8bd8-49905d6464f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:00:56.294402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e0a66-4b21-4583-8bd8-49905d6464f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:56.294402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e0a66-4b21-4583-8bd8-49905d6464f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:56.294402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e0a66-4b21-4583-8bd8-49905d6464f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:56.294762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-339e0a66-4b21-4583-8bd8-49905d6464f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:56.372973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:56.411487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e0a66-4b21-4583-8bd8-49905d6464f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:00:56.412956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e0a66-4b21-4583-8bd8-49905d6464f5 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:00:56.432445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 658/1325] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:00:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:00:58.609359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738b2fe-7935-47c3-8ade-809f3c0fadf0 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:58.609950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738b2fe-7935-47c3-8ade-809f3c0fadf0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:58.609950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c738b2fe-7935-47c3-8ade-809f3c0fadf0 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:58.611370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 668/1326] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:00:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:00:58.616903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a885-54aa-4fe2-9be1-7298af5a14f6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:58.617435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a885-54aa-4fe2-9be1-7298af5a14f6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:58.617613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a885-54aa-4fe2-9be1-7298af5a14f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:58.684476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1401a885-54aa-4fe2-9be1-7298af5a14f6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:00:58.685588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1401a885-54aa-4fe2-9be1-7298af5a14f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:58.790149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 659/1327] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:00:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:00:58.829476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738b2fe-7935-47c3-8ade-809f3c0fadf0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:00:58.831122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c738b2fe-7935-47c3-8ade-809f3c0fadf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:58.893644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:58.941652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c738b2fe-7935-47c3-8ade-809f3c0fadf0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:00:59.023356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3170cf7-b5f2-4d2f-b39c-fb8d68a9f2a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:00:59.024039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3170cf7-b5f2-4d2f-b39c-fb8d68a9f2a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:00:59.024317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3170cf7-b5f2-4d2f-b39c-fb8d68a9f2a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:00:59.024583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3170cf7-b5f2-4d2f-b39c-fb8d68a9f2a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:00:59.026214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b3170cf7-b5f2-4d2f-b39c-fb8d68a9f2a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:00:59.140120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:00:59.143406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3170cf7-b5f2-4d2f-b39c-fb8d68a9f2a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:00:59.144999 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3170cf7-b5f2-4d2f-b39c-fb8d68a9f2a8 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:00:59.164134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 669/1328] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:00:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:01.267450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadd908-eab8-444e-b2f1-8abd0ccb3611 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:01.268369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadd908-eab8-444e-b2f1-8abd0ccb3611 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:01.268959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbadd908-eab8-444e-b2f1-8abd0ccb3611 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:01.270706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 660/1329] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:01.276931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a374a4-0fe4-49bd-87b0-735667d05857 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:01.277506 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a374a4-0fe4-49bd-87b0-735667d05857 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:01.277609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a374a4-0fe4-49bd-87b0-735667d05857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:01.346852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-38a374a4-0fe4-49bd-87b0-735667d05857 None None] MFA Rules not processed for user `77833c08172c4aa2bc9b92c7124c3fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:01.348090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-38a374a4-0fe4-49bd-87b0-735667d05857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:01.444579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 670/1330] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:01.484322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadd908-eab8-444e-b2f1-8abd0ccb3611 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:01.485880 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fbadd908-eab8-444e-b2f1-8abd0ccb3611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:01.519972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:01.598877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbadd908-eab8-444e-b2f1-8abd0ccb3611 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:01.674847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173071a2-246f-4a59-9c2c-1658b0dbb4e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:01.675480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173071a2-246f-4a59-9c2c-1658b0dbb4e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:01.675758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173071a2-246f-4a59-9c2c-1658b0dbb4e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:01.676061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173071a2-246f-4a59-9c2c-1658b0dbb4e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:01.677863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-173071a2-246f-4a59-9c2c-1658b0dbb4e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:01.756434 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:01.791747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173071a2-246f-4a59-9c2c-1658b0dbb4e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:01.793754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173071a2-246f-4a59-9c2c-1658b0dbb4e6 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:01.816780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 661/1331] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:04.491091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3720e-66e9-4fe8-837e-1581148ebd2a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:04.491659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3720e-66e9-4fe8-837e-1581148ebd2a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:04.491659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3720e-66e9-4fe8-837e-1581148ebd2a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:04.493059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 671/1332] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:04.498342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62d9d-f008-4533-ac53-88e004a1b7e6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:04.498794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62d9d-f008-4533-ac53-88e004a1b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:04.498904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef62d9d-f008-4533-ac53-88e004a1b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:04.566643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0ef62d9d-f008-4533-ac53-88e004a1b7e6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:04.567962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0ef62d9d-f008-4533-ac53-88e004a1b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:04.675231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 662/1333] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:04.712162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3720e-66e9-4fe8-837e-1581148ebd2a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:04.713737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dbb3720e-66e9-4fe8-837e-1581148ebd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:04.784316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:04.819551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3720e-66e9-4fe8-837e-1581148ebd2a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:04.895266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431753f-49f3-41ec-96c5-1777608332df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:04.895907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431753f-49f3-41ec-96c5-1777608332df service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:04.896216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431753f-49f3-41ec-96c5-1777608332df service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:04.896487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431753f-49f3-41ec-96c5-1777608332df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:04.898152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1431753f-49f3-41ec-96c5-1777608332df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:05.009784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431753f-49f3-41ec-96c5-1777608332df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:05.011262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431753f-49f3-41ec-96c5-1777608332df service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:05.021663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:05.029804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 672/1334] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:01:07.211319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654e2ab-f948-4756-adf5-3923c09ab0ab None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:07.211791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654e2ab-f948-4756-adf5-3923c09ab0ab None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:07.211910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654e2ab-f948-4756-adf5-3923c09ab0ab None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:07.213305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 663/1335] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:07.218813 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d38d4d-af45-4a9f-96bb-7fff55996df1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:07.219305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d38d4d-af45-4a9f-96bb-7fff55996df1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:07.219400 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d38d4d-af45-4a9f-96bb-7fff55996df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:07.283540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-79d38d4d-af45-4a9f-96bb-7fff55996df1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:07.284793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-79d38d4d-af45-4a9f-96bb-7fff55996df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:07.386083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 673/1336] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:07.429858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654e2ab-f948-4756-adf5-3923c09ab0ab None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:07.431409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1654e2ab-f948-4756-adf5-3923c09ab0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:07.473298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:07.543160 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654e2ab-f948-4756-adf5-3923c09ab0ab None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:07.627323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42d9c2-773d-48f6-a3fa-2fb606a2cd65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:07.628011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d9c2-773d-48f6-a3fa-2fb606a2cd65 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:07.628409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d9c2-773d-48f6-a3fa-2fb606a2cd65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:07.628682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d9c2-773d-48f6-a3fa-2fb606a2cd65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:07.630347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7c42d9c2-773d-48f6-a3fa-2fb606a2cd65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:07.717062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:07.744254 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42d9c2-773d-48f6-a3fa-2fb606a2cd65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:07.745630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42d9c2-773d-48f6-a3fa-2fb606a2cd65 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:07.763824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 664/1337] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:10.542705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122673f6-2911-44e8-b7c9-553d72d55557 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:10.543249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122673f6-2911-44e8-b7c9-553d72d55557 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:10.543249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122673f6-2911-44e8-b7c9-553d72d55557 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:10.544717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 674/1338] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:10.550801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd4d36-4c54-481f-a40e-b17240c97283 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:10.551225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd4d36-4c54-481f-a40e-b17240c97283 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:10.551409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd4d36-4c54-481f-a40e-b17240c97283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:10.616859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dacd4d36-4c54-481f-a40e-b17240c97283 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:10.618121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dacd4d36-4c54-481f-a40e-b17240c97283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:10.720325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 665/1339] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:10.757670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122673f6-2911-44e8-b7c9-553d72d55557 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:10.759347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-122673f6-2911-44e8-b7c9-553d72d55557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:10.837584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:10.867886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122673f6-2911-44e8-b7c9-553d72d55557 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:10.941149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029b15e-a3b8-48d5-875d-14a1e2f977da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:10.941795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029b15e-a3b8-48d5-875d-14a1e2f977da service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:10.942081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029b15e-a3b8-48d5-875d-14a1e2f977da service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:10.942354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029b15e-a3b8-48d5-875d-14a1e2f977da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:10.944045 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c029b15e-a3b8-48d5-875d-14a1e2f977da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:11.061879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029b15e-a3b8-48d5-875d-14a1e2f977da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:11.063323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029b15e-a3b8-48d5-875d-14a1e2f977da service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:11.081471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 675/1340] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:15.499363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a5cb-003e-458f-99f2-2fdd7010866f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:15.500133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a5cb-003e-458f-99f2-2fdd7010866f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:15.500133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d685a5cb-003e-458f-99f2-2fdd7010866f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:15.501577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 666/1341] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:15.508179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220abeee-bb08-41f6-ad3d-b115938b41e3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:15.508699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220abeee-bb08-41f6-ad3d-b115938b41e3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:15.508804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220abeee-bb08-41f6-ad3d-b115938b41e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:15.513757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:15.584416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-220abeee-bb08-41f6-ad3d-b115938b41e3 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:15.585675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-220abeee-bb08-41f6-ad3d-b115938b41e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:15.694414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 676/1342] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:15.737510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685a5cb-003e-458f-99f2-2fdd7010866f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:15.739105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d685a5cb-003e-458f-99f2-2fdd7010866f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:15.790556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:15.847283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d685a5cb-003e-458f-99f2-2fdd7010866f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:15.925408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59dcdb-6620-410c-b20d-ca8663c92856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:15.926065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59dcdb-6620-410c-b20d-ca8663c92856 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:15.926388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59dcdb-6620-410c-b20d-ca8663c92856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:15.926737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59dcdb-6620-410c-b20d-ca8663c92856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:15.928436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fb59dcdb-6620-410c-b20d-ca8663c92856 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:16.036987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:16.054036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59dcdb-6620-410c-b20d-ca8663c92856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:16.055479 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59dcdb-6620-410c-b20d-ca8663c92856 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:16.073861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 667/1343] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:19.232166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9ae56-2aac-464c-a71d-cc0d6a7e38d2 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:19.232718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9ae56-2aac-464c-a71d-cc0d6a7e38d2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:19.232718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c9ae56-2aac-464c-a71d-cc0d6a7e38d2 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:19.234483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 677/1344] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:19.239813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcadc5-7ac6-4f24-80b1-63029315b3c9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:19.240253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcadc5-7ac6-4f24-80b1-63029315b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:19.240466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcadc5-7ac6-4f24-80b1-63029315b3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:19.307795 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fedcadc5-7ac6-4f24-80b1-63029315b3c9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:19.308967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fedcadc5-7ac6-4f24-80b1-63029315b3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:19.410693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 668/1345] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:19.448823 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9ae56-2aac-464c-a71d-cc0d6a7e38d2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:19.450357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-83c9ae56-2aac-464c-a71d-cc0d6a7e38d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:19.541022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:19.557971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c9ae56-2aac-464c-a71d-cc0d6a7e38d2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:19.634946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12a47a-cfbb-43e2-a843-afc814b37737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:19.635603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a47a-cfbb-43e2-a843-afc814b37737 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:19.635884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a47a-cfbb-43e2-a843-afc814b37737 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:19.636184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12a47a-cfbb-43e2-a843-afc814b37737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:19.637828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4d12a47a-cfbb-43e2-a843-afc814b37737 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:19.759059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12a47a-cfbb-43e2-a843-afc814b37737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:19.760540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12a47a-cfbb-43e2-a843-afc814b37737 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:19.779377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 678/1346] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:24.436705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c762c-96f6-49ff-b0c6-b2ef21d0f69f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:24.437186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c762c-96f6-49ff-b0c6-b2ef21d0f69f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:24.437280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332c762c-96f6-49ff-b0c6-b2ef21d0f69f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:24.438661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 669/1347] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:24.444447 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787cc3-b9cf-45b3-a310-d1beaa0cc115 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:24.444887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787cc3-b9cf-45b3-a310-d1beaa0cc115 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:24.445277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787cc3-b9cf-45b3-a310-d1beaa0cc115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:24.461062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:24.519590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a4787cc3-b9cf-45b3-a310-d1beaa0cc115 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:24.520858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a4787cc3-b9cf-45b3-a310-d1beaa0cc115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:24.618396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 679/1348] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:24.661055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c762c-96f6-49ff-b0c6-b2ef21d0f69f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:24.662589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-332c762c-96f6-49ff-b0c6-b2ef21d0f69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:24.723245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:24.770159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332c762c-96f6-49ff-b0c6-b2ef21d0f69f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:24.843588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89412c8-e97d-40a1-ab8a-221f20ed703d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:24.844257 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89412c8-e97d-40a1-ab8a-221f20ed703d service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:24.844535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89412c8-e97d-40a1-ab8a-221f20ed703d service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:24.844836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89412c8-e97d-40a1-ab8a-221f20ed703d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:24.846440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b89412c8-e97d-40a1-ab8a-221f20ed703d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:24.951800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:24.955026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89412c8-e97d-40a1-ab8a-221f20ed703d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:24.956501 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89412c8-e97d-40a1-ab8a-221f20ed703d service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:24.974451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 670/1349] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:29.930831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c944cf-3bfc-4749-9b13-927722c4b3c4 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:29.931337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c944cf-3bfc-4749-9b13-927722c4b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:29.931435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c944cf-3bfc-4749-9b13-927722c4b3c4 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:29.933106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 680/1350] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:01:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:29.940363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da9aef-0984-45ec-b1c2-adba45836d6a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:29.940807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da9aef-0984-45ec-b1c2-adba45836d6a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:29.940900 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da9aef-0984-45ec-b1c2-adba45836d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:30.078087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-82da9aef-0984-45ec-b1c2-adba45836d6a None None] MFA Rules not processed for user `4e52a3464d8f4a3fa16a102336a4bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:30.079304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-82da9aef-0984-45ec-b1c2-adba45836d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:30.207854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 671/1351] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:01:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:01:34.515669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468907f-99bb-47fd-acf8-48dc36f51d78 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:34.515669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468907f-99bb-47fd-acf8-48dc36f51d78 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:34.516370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468907f-99bb-47fd-acf8-48dc36f51d78 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:34.517530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 681/1352] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:01:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:34.522825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c1be-3313-4325-9373-f30d3235dd4b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:34.523309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c1be-3313-4325-9373-f30d3235dd4b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:34.523406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638c1be-3313-4325-9373-f30d3235dd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:34.579870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:34.602757 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5638c1be-3313-4325-9373-f30d3235dd4b None None] MFA Rules not processed for user `4e52a3464d8f4a3fa16a102336a4bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:34.604019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5638c1be-3313-4325-9373-f30d3235dd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:34.616492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=59 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:34.723598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 672/1353] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:01:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:36.102083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510c95-127b-4d4d-af37-7e8d86e37298 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:36.102613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510c95-127b-4d4d-af37-7e8d86e37298 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:36.102613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7510c95-127b-4d4d-af37-7e8d86e37298 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:36.104039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 682/1354] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:01:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:36.109109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330c8b7-45c3-47a4-92b0-2e5846ab36de None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:36.109579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330c8b7-45c3-47a4-92b0-2e5846ab36de None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:36.109697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4330c8b7-45c3-47a4-92b0-2e5846ab36de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:36.189411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4330c8b7-45c3-47a4-92b0-2e5846ab36de None None] MFA Rules not processed for user `4e52a3464d8f4a3fa16a102336a4bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:36.190642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4330c8b7-45c3-47a4-92b0-2e5846ab36de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:36.232109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:36.306840 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 673/1355] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:01:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:39.704247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35745b-711c-4f94-bbcf-0d4986c03fa3 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:39.705139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35745b-711c-4f94-bbcf-0d4986c03fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:39.705611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba35745b-711c-4f94-bbcf-0d4986c03fa3 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:39.707171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 683/1356] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:39.713075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04679f7-c2ff-4f19-83fa-9a1d7e7be9fd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:39.714224 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04679f7-c2ff-4f19-83fa-9a1d7e7be9fd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:39.714711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04679f7-c2ff-4f19-83fa-9a1d7e7be9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:39.791255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e04679f7-c2ff-4f19-83fa-9a1d7e7be9fd None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:39.792492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e04679f7-c2ff-4f19-83fa-9a1d7e7be9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:39.902698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 674/1357] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:39.962243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309c7bb-23eb-4ff0-929a-076a2f3c4641 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:39.962833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309c7bb-23eb-4ff0-929a-076a2f3c4641 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:39.963318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b309c7bb-23eb-4ff0-929a-076a2f3c4641 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:39.965551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 684/1358] 10.222.0.85 () {54 vars in 962 bytes} [Wed Jul 20 22:01:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:39.976452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d995-65bf-4788-be87-514f04d41a78 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:39.976737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d995-65bf-4788-be87-514f04d41a78 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:39.977024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53d995-65bf-4788-be87-514f04d41a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:39.997286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:40.058067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ba53d995-65bf-4788-be87-514f04d41a78 None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:40.059267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ba53d995-65bf-4788-be87-514f04d41a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:40.183718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 675/1359] 10.222.0.85 () {58 vars in 1059 bytes} [Wed Jul 20 22:01:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:40.192656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309c7bb-23eb-4ff0-929a-076a2f3c4641 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:40.194139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b309c7bb-23eb-4ff0-929a-076a2f3c4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:40.344198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b309c7bb-23eb-4ff0-929a-076a2f3c4641 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:40.428583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:40.469644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb61874a-66d5-4c8b-b763-0808648b6b00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:40.470189 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61874a-66d5-4c8b-b763-0808648b6b00 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:40.470468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61874a-66d5-4c8b-b763-0808648b6b00 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:40.470874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb61874a-66d5-4c8b-b763-0808648b6b00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:40.472378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eb61874a-66d5-4c8b-b763-0808648b6b00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:40.572837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61874a-66d5-4c8b-b763-0808648b6b00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:40.574648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb61874a-66d5-4c8b-b763-0808648b6b00 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:40.595764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 685/1360] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:42.904982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48529dbb-f9bc-4e78-9eba-38cdd9a1915b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:42.905875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48529dbb-f9bc-4e78-9eba-38cdd9a1915b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:42.905875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48529dbb-f9bc-4e78-9eba-38cdd9a1915b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:42.907345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 676/1361] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:42.913058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e3fa2-fe2b-4c86-a0f8-21729cd97d63 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:42.913498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e3fa2-fe2b-4c86-a0f8-21729cd97d63 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:42.913734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e3fa2-fe2b-4c86-a0f8-21729cd97d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:42.989512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-474e3fa2-fe2b-4c86-a0f8-21729cd97d63 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:42.990792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-474e3fa2-fe2b-4c86-a0f8-21729cd97d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:43.032219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:43.095974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 686/1362] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:43.150903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48529dbb-f9bc-4e78-9eba-38cdd9a1915b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:43.152477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-48529dbb-f9bc-4e78-9eba-38cdd9a1915b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:43.236121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:43.335622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48529dbb-f9bc-4e78-9eba-38cdd9a1915b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:43.493565 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26e9e6-1f3d-4fbf-99e5-ca1a43bf8c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:43.494220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26e9e6-1f3d-4fbf-99e5-ca1a43bf8c42 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:43.494500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26e9e6-1f3d-4fbf-99e5-ca1a43bf8c42 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:43.494774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26e9e6-1f3d-4fbf-99e5-ca1a43bf8c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:43.496440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aa26e9e6-1f3d-4fbf-99e5-ca1a43bf8c42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:43.522951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:43.605142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26e9e6-1f3d-4fbf-99e5-ca1a43bf8c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:43.606818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26e9e6-1f3d-4fbf-99e5-ca1a43bf8c42 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:43.632150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 677/1363] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:46.225479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2034ab-b335-4767-9fae-792766c8db83 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:46.226057 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2034ab-b335-4767-9fae-792766c8db83 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:46.226057 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2034ab-b335-4767-9fae-792766c8db83 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:46.227421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 687/1364] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:46.232969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4901f8-0eae-4206-88d2-d8987b6941b3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:46.233781 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4901f8-0eae-4206-88d2-d8987b6941b3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:46.234231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4901f8-0eae-4206-88d2-d8987b6941b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:46.304468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aa4901f8-0eae-4206-88d2-d8987b6941b3 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:46.305854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aa4901f8-0eae-4206-88d2-d8987b6941b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:46.406946 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:46.409799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 678/1365] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:46.456870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e7b1e-a096-4218-8b2c-e5f6bc24f39a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:46.457152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e7b1e-a096-4218-8b2c-e5f6bc24f39a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:46.457425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e7b1e-a096-4218-8b2c-e5f6bc24f39a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:46.458779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 688/1366] 10.222.0.85 () {54 vars in 962 bytes} [Wed Jul 20 22:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:46.464126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8baed-05ed-4f7d-9b08-fb8fa91fbedd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:46.464410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8baed-05ed-4f7d-9b08-fb8fa91fbedd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:46.464681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8baed-05ed-4f7d-9b08-fb8fa91fbedd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:46.555024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8ca8baed-05ed-4f7d-9b08-fb8fa91fbedd None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:46.558089 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8ca8baed-05ed-4f7d-9b08-fb8fa91fbedd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:46.691392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 679/1367] 10.222.0.85 () {58 vars in 1059 bytes} [Wed Jul 20 22:01:46 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:46.692659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e7b1e-a096-4218-8b2c-e5f6bc24f39a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:46.694625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-540e7b1e-a096-4218-8b2c-e5f6bc24f39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:46.867052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540e7b1e-a096-4218-8b2c-e5f6bc24f39a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:46.889617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:46.997077 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2a7b7-6255-4b97-8a3a-ab80ac6594d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:46.998430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2a7b7-6255-4b97-8a3a-ab80ac6594d4 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:46.998778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2a7b7-6255-4b97-8a3a-ab80ac6594d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:46.999118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2a7b7-6255-4b97-8a3a-ab80ac6594d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:47.000938 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e9b2a7b7-6255-4b97-8a3a-ab80ac6594d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:47.100909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2a7b7-6255-4b97-8a3a-ab80ac6594d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:47.102614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2a7b7-6255-4b97-8a3a-ab80ac6594d4 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:47.136208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 689/1368] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:48.015683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dda428-f9aa-43bd-9110-f92665adbf17 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:48.016276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dda428-f9aa-43bd-9110-f92665adbf17 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:48.016276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dda428-f9aa-43bd-9110-f92665adbf17 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:48.017865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 680/1369] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:48.023018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e537cad-dd63-4c0d-99f0-b12ac23ce767 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:48.023442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e537cad-dd63-4c0d-99f0-b12ac23ce767 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:48.023617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e537cad-dd63-4c0d-99f0-b12ac23ce767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:48.056607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:48.092128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1e537cad-dd63-4c0d-99f0-b12ac23ce767 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:48.093504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1e537cad-dd63-4c0d-99f0-b12ac23ce767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:48.203750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 690/1370] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:48.552674 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12db39-89cb-49ce-b79f-596ffceee110 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:48.552960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12db39-89cb-49ce-b79f-596ffceee110 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:48.553239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c12db39-89cb-49ce-b79f-596ffceee110 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:48.554772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 681/1371] 10.222.0.85 () {54 vars in 964 bytes} [Wed Jul 20 22:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:48.559588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f57d05-72de-492b-bfa6-830d77c082a0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:48.559876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f57d05-72de-492b-bfa6-830d77c082a0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:48.560211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f57d05-72de-492b-bfa6-830d77c082a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:48.638546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a9f57d05-72de-492b-bfa6-830d77c082a0 None None] MFA Rules not processed for user `7153a137b4734df1a057d26509d53dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:48.639765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a9f57d05-72de-492b-bfa6-830d77c082a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:48.691567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:48.724080 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 691/1372] 10.222.0.85 () {58 vars in 1061 bytes} [Wed Jul 20 22:01:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:48.731652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12db39-89cb-49ce-b79f-596ffceee110 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:48.734041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6c12db39-89cb-49ce-b79f-596ffceee110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:48.792151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:48.858518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c12db39-89cb-49ce-b79f-596ffceee110 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:48.945578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7933c7c0-1d1d-47a0-aaec-17e2a81d57b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:48.945578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c7c0-1d1d-47a0-aaec-17e2a81d57b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:48.945578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c7c0-1d1d-47a0-aaec-17e2a81d57b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:48.945578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7933c7c0-1d1d-47a0-aaec-17e2a81d57b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:48.946017 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7933c7c0-1d1d-47a0-aaec-17e2a81d57b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:49.053976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:49.069185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933c7c0-1d1d-47a0-aaec-17e2a81d57b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:49.070891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7933c7c0-1d1d-47a0-aaec-17e2a81d57b5 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:49.092842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 682/1373] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:01:49.391897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab660652-7229-406d-8c04-a00d7d60d4b8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:49.392364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab660652-7229-406d-8c04-a00d7d60d4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:49.392714 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab660652-7229-406d-8c04-a00d7d60d4b8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:49.394164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 692/1374] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:49.400925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7573201-c735-44d7-a111-2e40a126fb15 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:49.400925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7573201-c735-44d7-a111-2e40a126fb15 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:49.400925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7573201-c735-44d7-a111-2e40a126fb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:49.468432 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d7573201-c735-44d7-a111-2e40a126fb15 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:49.469626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d7573201-c735-44d7-a111-2e40a126fb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:49.580154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 683/1375] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:01:49.619987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab660652-7229-406d-8c04-a00d7d60d4b8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:49.621494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ab660652-7229-406d-8c04-a00d7d60d4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:49.774449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab660652-7229-406d-8c04-a00d7d60d4b8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:49.828214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:49.891393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9807c70-c4a5-4ad0-9f1d-bdc6c1872af3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:49.892033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807c70-c4a5-4ad0-9f1d-bdc6c1872af3 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:49.892272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807c70-c4a5-4ad0-9f1d-bdc6c1872af3 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:49.892546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9807c70-c4a5-4ad0-9f1d-bdc6c1872af3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:49.894568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c9807c70-c4a5-4ad0-9f1d-bdc6c1872af3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:49.996431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9807c70-c4a5-4ad0-9f1d-bdc6c1872af3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:49.998138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9807c70-c4a5-4ad0-9f1d-bdc6c1872af3 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:50.016839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 693/1376] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:52.208891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc33c1-37ef-4644-8ece-a4036a646c82 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:52.209382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc33c1-37ef-4644-8ece-a4036a646c82 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:52.209463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc33c1-37ef-4644-8ece-a4036a646c82 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:52.210813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 684/1377] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:52.217019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78527bb5-d6a9-4150-861f-8356b6f7108d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:52.217469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78527bb5-d6a9-4150-861f-8356b6f7108d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:52.217678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78527bb5-d6a9-4150-861f-8356b6f7108d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:52.287042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-78527bb5-d6a9-4150-861f-8356b6f7108d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:52.288413 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-78527bb5-d6a9-4150-861f-8356b6f7108d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:52.302837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:52.398549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 694/1378] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:52.442457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc33c1-37ef-4644-8ece-a4036a646c82 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:52.443998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7afc33c1-37ef-4644-8ece-a4036a646c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:52.505921 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:52.594168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc33c1-37ef-4644-8ece-a4036a646c82 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:52.732544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00cb95-e783-4043-abb5-a693bd4765f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:52.733201 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00cb95-e783-4043-abb5-a693bd4765f2 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:52.733484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00cb95-e783-4043-abb5-a693bd4765f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:52.733760 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00cb95-e783-4043-abb5-a693bd4765f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:52.735508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7d00cb95-e783-4043-abb5-a693bd4765f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:52.766776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:52.859229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00cb95-e783-4043-abb5-a693bd4765f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:52.861787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00cb95-e783-4043-abb5-a693bd4765f2 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:52.888536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 685/1379] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:55.109731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a083-1d71-4076-b090-40070c9c8083 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:55.110228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a083-1d71-4076-b090-40070c9c8083 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:55.110336 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4955a083-1d71-4076-b090-40070c9c8083 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:55.111833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 695/1380] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:55.117405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdc8ee-b6e4-4e08-a240-19faea9746b7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:55.117899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdc8ee-b6e4-4e08-a240-19faea9746b7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:55.118168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdc8ee-b6e4-4e08-a240-19faea9746b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:55.202239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-93fdc8ee-b6e4-4e08-a240-19faea9746b7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:55.203848 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-93fdc8ee-b6e4-4e08-a240-19faea9746b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:55.318920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:55.326495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 686/1381] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:55.380897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955a083-1d71-4076-b090-40070c9c8083 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:55.382510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4955a083-1d71-4076-b090-40070c9c8083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:55.538641 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:55.550112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4955a083-1d71-4076-b090-40070c9c8083 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:55.676899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ffc7d-42ff-41c8-894c-675c6cd78406 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:55.677554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ffc7d-42ff-41c8-894c-675c6cd78406 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:55.677848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ffc7d-42ff-41c8-894c-675c6cd78406 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:55.678119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ffc7d-42ff-41c8-894c-675c6cd78406 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:55.679781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6a7ffc7d-42ff-41c8-894c-675c6cd78406 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:55.797854 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ffc7d-42ff-41c8-894c-675c6cd78406 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:55.800015 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ffc7d-42ff-41c8-894c-675c6cd78406 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:55.814652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:55.826766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 696/1382] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:01:58.496128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87c33d-0308-4cb3-ad7e-03f5f3745797 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:58.496700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87c33d-0308-4cb3-ad7e-03f5f3745797 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:58.496877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87c33d-0308-4cb3-ad7e-03f5f3745797 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:58.499263 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 687/1383] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:01:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:01:58.507346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e6e19-a1ac-4616-ad99-6b9171ac05a3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:58.507870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e6e19-a1ac-4616-ad99-6b9171ac05a3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:58.508220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81e6e19-a1ac-4616-ad99-6b9171ac05a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:58.607201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a81e6e19-a1ac-4616-ad99-6b9171ac05a3 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:01:58.608482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a81e6e19-a1ac-4616-ad99-6b9171ac05a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:58.719311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 697/1384] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:01:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:01:58.761104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87c33d-0308-4cb3-ad7e-03f5f3745797 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:01:58.762579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3a87c33d-0308-4cb3-ad7e-03f5f3745797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:58.963019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87c33d-0308-4cb3-ad7e-03f5f3745797 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:01:59.063448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:01:59.112819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646316f9-0d33-4aa8-b56e-b235a26dbe56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:01:59.113497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646316f9-0d33-4aa8-b56e-b235a26dbe56 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:01:59.113788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646316f9-0d33-4aa8-b56e-b235a26dbe56 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:01:59.114065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646316f9-0d33-4aa8-b56e-b235a26dbe56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:01:59.115752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-646316f9-0d33-4aa8-b56e-b235a26dbe56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:01:59.207887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646316f9-0d33-4aa8-b56e-b235a26dbe56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:01:59.209519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646316f9-0d33-4aa8-b56e-b235a26dbe56 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:01:59.231265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 688/1385] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:01:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:01.411517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c9214-00cd-4117-985c-42e447245aba None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:01.412057 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c9214-00cd-4117-985c-42e447245aba None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:01.414055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c9214-00cd-4117-985c-42e447245aba None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:01.415475 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 698/1386] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:02:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:01.421407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654adca9-a37a-4965-94ee-076c4817c637 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:01.422014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654adca9-a37a-4965-94ee-076c4817c637 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:01.422014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654adca9-a37a-4965-94ee-076c4817c637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:01.501864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-654adca9-a37a-4965-94ee-076c4817c637 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:01.502947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-654adca9-a37a-4965-94ee-076c4817c637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:01.538079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:01.611269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 689/1387] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:02:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:01.656291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c9214-00cd-4117-985c-42e447245aba None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:01.657810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-209c9214-00cd-4117-985c-42e447245aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:01.747715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:01.832520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c9214-00cd-4117-985c-42e447245aba None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:01.957319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a80d3-8c6f-4635-b1c1-f3142d17addf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:01.958026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a80d3-8c6f-4635-b1c1-f3142d17addf service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:01.960049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a80d3-8c6f-4635-b1c1-f3142d17addf service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:01.960049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a80d3-8c6f-4635-b1c1-f3142d17addf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:01.960500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-da0a80d3-8c6f-4635-b1c1-f3142d17addf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:02.002167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:02.061965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a80d3-8c6f-4635-b1c1-f3142d17addf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:02.063572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a80d3-8c6f-4635-b1c1-f3142d17addf service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:02.083173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 699/1388] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:02:04.389330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0751a02-15f8-45b3-aba6-b55ebfe1cc82 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:04.389896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0751a02-15f8-45b3-aba6-b55ebfe1cc82 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:04.389896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0751a02-15f8-45b3-aba6-b55ebfe1cc82 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:04.391309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 690/1389] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:04.396845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49c456-d85f-4a13-b420-7560263cb171 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:04.397281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49c456-d85f-4a13-b420-7560263cb171 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:04.397389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49c456-d85f-4a13-b420-7560263cb171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:04.462788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-cc49c456-d85f-4a13-b420-7560263cb171 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:04.464109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cc49c456-d85f-4a13-b420-7560263cb171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:04.572016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 700/1390] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:04.621327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0751a02-15f8-45b3-aba6-b55ebfe1cc82 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:04.622871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d0751a02-15f8-45b3-aba6-b55ebfe1cc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:04.777233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0751a02-15f8-45b3-aba6-b55ebfe1cc82 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:04.795072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:04.798555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355418c-a9a7-4cc0-a52e-3f4cb4e96302 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:04.798844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355418c-a9a7-4cc0-a52e-3f4cb4e96302 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:04.799124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355418c-a9a7-4cc0-a52e-3f4cb4e96302 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:04.800539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 701/1391] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:02:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:02:04.805672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c984-f4f3-4bec-9c79-ef40c7afdd66 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:04.812911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c984-f4f3-4bec-9c79-ef40c7afdd66 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:04.812911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c984-f4f3-4bec-9c79-ef40c7afdd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:04.820256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:04.874403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0c48c984-f4f3-4bec-9c79-ef40c7afdd66 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:04.875616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0c48c984-f4f3-4bec-9c79-ef40c7afdd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:04.898440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aad2f9-a32c-471d-84ea-3e8f9ca87589 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:04.899087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aad2f9-a32c-471d-84ea-3e8f9ca87589 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:04.899368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aad2f9-a32c-471d-84ea-3e8f9ca87589 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:04.899636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aad2f9-a32c-471d-84ea-3e8f9ca87589 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:04.901319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-59aad2f9-a32c-471d-84ea-3e8f9ca87589 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:04.975407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 702/1392] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:02:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:02:04.994631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aad2f9-a32c-471d-84ea-3e8f9ca87589 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:04.996280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aad2f9-a32c-471d-84ea-3e8f9ca87589 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:05.018085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 691/1393] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:05.035800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa275f-a5c2-4919-8289-8536b45de30c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:05.036052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa275f-a5c2-4919-8289-8536b45de30c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:05.036331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa275f-a5c2-4919-8289-8536b45de30c None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:05.037688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 703/1394] 10.222.0.85 () {54 vars in 966 bytes} [Wed Jul 20 22:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:05.042758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b68c1-51bf-45f7-8b7e-7777aa1aff73 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:05.043048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b68c1-51bf-45f7-8b7e-7777aa1aff73 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:05.043327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b68c1-51bf-45f7-8b7e-7777aa1aff73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:05.067991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:05.118033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-299b68c1-51bf-45f7-8b7e-7777aa1aff73 None None] MFA Rules not processed for user `2169b05e64224f69bcc1d9ce912a60e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:05.119251 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-299b68c1-51bf-45f7-8b7e-7777aa1aff73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:05.201198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 692/1395] 10.222.0.85 () {58 vars in 1063 bytes} [Wed Jul 20 22:02:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:05.208884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa275f-a5c2-4919-8289-8536b45de30c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:05.210378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-48fa275f-a5c2-4919-8289-8536b45de30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:05.313252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:05.321746 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa275f-a5c2-4919-8289-8536b45de30c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:05.403314 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfecae0-e6e0-4356-b2a7-c2e19b537e14 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2169b05e64224f69bcc1d9ce912a60e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:05.404241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfecae0-e6e0-4356-b2a7-c2e19b537e14 service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:05.404445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfecae0-e6e0-4356-b2a7-c2e19b537e14 service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:05.404665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfecae0-e6e0-4356-b2a7-c2e19b537e14 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:05.406615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3cfecae0-e6e0-4356-b2a7-c2e19b537e14 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:05.522455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfecae0-e6e0-4356-b2a7-c2e19b537e14 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:05.523944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfecae0-e6e0-4356-b2a7-c2e19b537e14 service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:05.544521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 704/1396] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:06.396202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4abfb-237f-45b4-9b2d-e35f3cc42f99 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:06.396737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4abfb-237f-45b4-9b2d-e35f3cc42f99 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:06.397033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4abfb-237f-45b4-9b2d-e35f3cc42f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:06.469913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d3d4abfb-237f-45b4-9b2d-e35f3cc42f99 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:06.471132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d3d4abfb-237f-45b4-9b2d-e35f3cc42f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:06.533117 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:06.561061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 693/1397] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:02:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:02:06.604795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2652-7123-4f75-9b91-2d511d4c6e26 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:06.605284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2652-7123-4f75-9b91-2d511d4c6e26 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:06.605394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aa2652-7123-4f75-9b91-2d511d4c6e26 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:06.606972 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 705/1398] 10.222.0.85 () {54 vars in 943 bytes} [Wed Jul 20 22:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:06.612984 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc3b89-daa9-4032-990f-b296d245b600 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:06.613278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc3b89-daa9-4032-990f-b296d245b600 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:06.613561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc3b89-daa9-4032-990f-b296d245b600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:06.690334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-affc3b89-daa9-4032-990f-b296d245b600 None None] MFA Rules not processed for user `dff5a11076ea426a8bf760bfee7a5023`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:06.691553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-affc3b89-daa9-4032-990f-b296d245b600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:06.804261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 694/1399] 10.222.0.85 () {58 vars in 1040 bytes} [Wed Jul 20 22:02:06 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:06.814113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2652-7123-4f75-9b91-2d511d4c6e26 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:06.815646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e9aa2652-7123-4f75-9b91-2d511d4c6e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:06.839421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:06.958061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aa2652-7123-4f75-9b91-2d511d4c6e26 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:07.064768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb7d28d-c3fc-4a36-86e7-13fe36215ce6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:07.065331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7d28d-c3fc-4a36-86e7-13fe36215ce6 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:07.065606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7d28d-c3fc-4a36-86e7-13fe36215ce6 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:07.065878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb7d28d-c3fc-4a36-86e7-13fe36215ce6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:07.067550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ddb7d28d-c3fc-4a36-86e7-13fe36215ce6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:07.074651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:07.153771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7d28d-c3fc-4a36-86e7-13fe36215ce6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:07.155372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb7d28d-c3fc-4a36-86e7-13fe36215ce6 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:07.164078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 706/1400] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:02:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 22:02:07.277532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adeec-6cd0-44f1-8bae-a25b74a5d6e8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:07.277824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adeec-6cd0-44f1-8bae-a25b74a5d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:07.278708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6adeec-6cd0-44f1-8bae-a25b74a5d6e8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:07.280351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 695/1401] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:02:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:07.285774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e00f1-e6fb-4b56-aebf-49cfc325edb2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:07.286058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e00f1-e6fb-4b56-aebf-49cfc325edb2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:07.286335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7e00f1-e6fb-4b56-aebf-49cfc325edb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:07.350343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fd7e00f1-e6fb-4b56-aebf-49cfc325edb2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:07.351460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fd7e00f1-e6fb-4b56-aebf-49cfc325edb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:07.460583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:07.464247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 707/1402] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:02:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:02:07.513137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6adeec-6cd0-44f1-8bae-a25b74a5d6e8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:07.515430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2d6adeec-6cd0-44f1-8bae-a25b74a5d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:07.566710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:07.696361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6adeec-6cd0-44f1-8bae-a25b74a5d6e8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:07.838091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:07.841479 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3056f28-df24-487e-9bab-453a19666766 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:07.842152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3056f28-df24-487e-9bab-453a19666766 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:07.842424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3056f28-df24-487e-9bab-453a19666766 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:07.842701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3056f28-df24-487e-9bab-453a19666766 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:07.844418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e3056f28-df24-487e-9bab-453a19666766 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:07.957402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3056f28-df24-487e-9bab-453a19666766 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:07.959026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3056f28-df24-487e-9bab-453a19666766 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:07.983211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 696/1403] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:10.323249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2078d3-dc42-4080-95be-7a410f271ae1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:10.336290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2078d3-dc42-4080-95be-7a410f271ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:10.336290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2078d3-dc42-4080-95be-7a410f271ae1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:10.336290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 708/1404] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:02:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:02:10.336632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb88b-e047-4139-abd5-41ed9a8b2cdd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:10.336632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb88b-e047-4139-abd5-41ed9a8b2cdd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:10.336632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fb88b-e047-4139-abd5-41ed9a8b2cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:10.437196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-910fb88b-e047-4139-abd5-41ed9a8b2cdd None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:10.438904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-910fb88b-e047-4139-abd5-41ed9a8b2cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:10.520515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:10.564022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 697/1405] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:02:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:10.611698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2078d3-dc42-4080-95be-7a410f271ae1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:10.613315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3e2078d3-dc42-4080-95be-7a410f271ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:10.785122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2078d3-dc42-4080-95be-7a410f271ae1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:10.876685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:10.925176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60855d5c-ba9d-4e96-87f3-531618df470e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:10.925829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855d5c-ba9d-4e96-87f3-531618df470e service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:10.926111 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855d5c-ba9d-4e96-87f3-531618df470e service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:10.926388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60855d5c-ba9d-4e96-87f3-531618df470e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:10.928203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-60855d5c-ba9d-4e96-87f3-531618df470e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:11.035139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60855d5c-ba9d-4e96-87f3-531618df470e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:11.036795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60855d5c-ba9d-4e96-87f3-531618df470e service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:11.059961 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 709/1406] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:13.259469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd57007-43af-442c-b9ec-dcf8b4d11939 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:13.259995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd57007-43af-442c-b9ec-dcf8b4d11939 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:13.260105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd57007-43af-442c-b9ec-dcf8b4d11939 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:13.265975 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 698/1407] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:02:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:13.267443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebf881-1ded-4c87-9d6b-b47ef64385e9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:13.267946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebf881-1ded-4c87-9d6b-b47ef64385e9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:13.268055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebf881-1ded-4c87-9d6b-b47ef64385e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:13.341844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1cebf881-1ded-4c87-9d6b-b47ef64385e9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:13.348329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1cebf881-1ded-4c87-9d6b-b47ef64385e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:13.387035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:13.460382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 710/1408] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:02:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:13.505688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd57007-43af-442c-b9ec-dcf8b4d11939 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:13.507210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3cd57007-43af-442c-b9ec-dcf8b4d11939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:13.678985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd57007-43af-442c-b9ec-dcf8b4d11939 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:13.751710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:13.816249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ea7d7e-2d49-40ac-bcba-fe5e41b861f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:13.816910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea7d7e-2d49-40ac-bcba-fe5e41b861f1 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:13.817197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea7d7e-2d49-40ac-bcba-fe5e41b861f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:13.817478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ea7d7e-2d49-40ac-bcba-fe5e41b861f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:13.819147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-20ea7d7e-2d49-40ac-bcba-fe5e41b861f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:13.925307 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea7d7e-2d49-40ac-bcba-fe5e41b861f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:13.927040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ea7d7e-2d49-40ac-bcba-fe5e41b861f1 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:13.950622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 699/1409] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:23.455324 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=27 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:23.947493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=73 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:31.200225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38030982-201c-456e-ab53-12feda78263f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:31.200774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38030982-201c-456e-ab53-12feda78263f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:31.200774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38030982-201c-456e-ab53-12feda78263f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:31.202782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 711/1410] 10.222.0.85 () {54 vars in 918 bytes} [Wed Jul 20 22:02:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:31.208044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9d55-3673-483c-8026-e910f0489b2e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:31.208471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9d55-3673-483c-8026-e910f0489b2e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:31.208594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac9d55-3673-483c-8026-e910f0489b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:31.288002 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a4ac9d55-3673-483c-8026-e910f0489b2e None None] MFA Rules not processed for user `4e52a3464d8f4a3fa16a102336a4bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:31.289236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a4ac9d55-3673-483c-8026-e910f0489b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:31.395977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 700/1411] 10.222.0.85 () {58 vars in 1015 bytes} [Wed Jul 20 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:31.410714 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc68e6-72f3-488a-b357-d801520c39a0 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:31.411008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc68e6-72f3-488a-b357-d801520c39a0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:31.411292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc68e6-72f3-488a-b357-d801520c39a0 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:31.412709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 712/1412] 10.222.0.85 () {54 vars in 918 bytes} [Wed Jul 20 22:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:02:31.417164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba902a-30f8-435b-9ec6-e6c31c958738 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:31.417458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba902a-30f8-435b-9ec6-e6c31c958738 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:31.417770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba902a-30f8-435b-9ec6-e6c31c958738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:31.491027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:31.493938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ebba902a-30f8-435b-9ec6-e6c31c958738 None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:31.495189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ebba902a-30f8-435b-9ec6-e6c31c958738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:31.619292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 701/1413] 10.222.0.85 () {58 vars in 1015 bytes} [Wed Jul 20 22:02:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:34.152877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7e6c-d65f-411b-8ede-338f5ac6213c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:34.153405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7e6c-d65f-411b-8ede-338f5ac6213c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:34.153405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e7e6c-d65f-411b-8ede-338f5ac6213c None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:34.154861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:34.160630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adbb68-9069-44ec-88cb-3ec7ebd52fd9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:34.161046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adbb68-9069-44ec-88cb-3ec7ebd52fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:34.161193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97adbb68-9069-44ec-88cb-3ec7ebd52fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:34.228742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-97adbb68-9069-44ec-88cb-3ec7ebd52fd9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:34.229948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-97adbb68-9069-44ec-88cb-3ec7ebd52fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:34.286236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:34.329188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:34.371310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e7e6c-d65f-411b-8ede-338f5ac6213c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:34.373677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4d8e7e6c-d65f-411b-8ede-338f5ac6213c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:34.520722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e7e6c-d65f-411b-8ede-338f5ac6213c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:34.594089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:34.634257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c66813-ab2f-4a90-84bc-856c037b179c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:34.634906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c66813-ab2f-4a90-84bc-856c037b179c service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:34.635182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c66813-ab2f-4a90-84bc-856c037b179c service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:34.635652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c66813-ab2f-4a90-84bc-856c037b179c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:34.637974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-21c66813-ab2f-4a90-84bc-856c037b179c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:34.729941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c66813-ab2f-4a90-84bc-856c037b179c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:34.731549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c66813-ab2f-4a90-84bc-856c037b179c service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:34.751778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 714/1416] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:35.669293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a1f96-1fa2-4366-aaf7-9245313c61e2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:35.670344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a1f96-1fa2-4366-aaf7-9245313c61e2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:35.670344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a1f96-1fa2-4366-aaf7-9245313c61e2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:35.671273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:35.676304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb9be-ea0c-4406-9562-428b291c3fcb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:35.676759 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb9be-ea0c-4406-9562-428b291c3fcb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:35.676935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eb9be-ea0c-4406-9562-428b291c3fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:35.753564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-af0eb9be-ea0c-4406-9562-428b291c3fcb None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:35.754762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-af0eb9be-ea0c-4406-9562-428b291c3fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:35.781983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:35.851872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:02:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:36.006398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a1f96-1fa2-4366-aaf7-9245313c61e2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:36.008288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a96a1f96-1fa2-4366-aaf7-9245313c61e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:36.165159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a1f96-1fa2-4366-aaf7-9245313c61e2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:36.209014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:36.284467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537b526-1879-449a-a3db-33b00adc691c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:36.285099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537b526-1879-449a-a3db-33b00adc691c service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:36.285378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537b526-1879-449a-a3db-33b00adc691c service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:36.285646 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537b526-1879-449a-a3db-33b00adc691c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:36.287277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0537b526-1879-449a-a3db-33b00adc691c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:36.378220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537b526-1879-449a-a3db-33b00adc691c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:36.379843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0537b526-1879-449a-a3db-33b00adc691c service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:36.397943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 704/1419] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:37.284745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b4d95-c6be-410b-ac28-b42fe3bca82f None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:37.285219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b4d95-c6be-410b-ac28-b42fe3bca82f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:37.285331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b4d95-c6be-410b-ac28-b42fe3bca82f None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:37.286668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:37.291589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad57cd-9329-4f4c-a229-1480eca760fc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:37.292060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad57cd-9329-4f4c-a229-1480eca760fc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:37.292201 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad57cd-9329-4f4c-a229-1480eca760fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:37.347239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:37.369973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c1ad57cd-9329-4f4c-a229-1480eca760fc None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:37.371218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c1ad57cd-9329-4f4c-a229-1480eca760fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:37.469881 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:02:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:37.626588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b4d95-c6be-410b-ac28-b42fe3bca82f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:37.628071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-125b4d95-c6be-410b-ac28-b42fe3bca82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:37.776680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b4d95-c6be-410b-ac28-b42fe3bca82f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:37.789050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:37.892075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b43ec3-a7e8-4baf-a19b-36ef9ea436ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:37.892640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43ec3-a7e8-4baf-a19b-36ef9ea436ef service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:37.892922 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43ec3-a7e8-4baf-a19b-36ef9ea436ef service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:37.893200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b43ec3-a7e8-4baf-a19b-36ef9ea436ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:37.894850 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-41b43ec3-a7e8-4baf-a19b-36ef9ea436ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:37.985701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b43ec3-a7e8-4baf-a19b-36ef9ea436ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:37.987307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b43ec3-a7e8-4baf-a19b-36ef9ea436ef service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:38.004975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 717/1422] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:38.885193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a8e95-21d3-4b05-99f3-7b43d6fd041c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:38.885785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a8e95-21d3-4b05-99f3-7b43d6fd041c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:38.885785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a8e95-21d3-4b05-99f3-7b43d6fd041c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:38.887109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:38.892929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb119f4-fbf3-497b-8bf9-76a41922dfcc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:38.893365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb119f4-fbf3-497b-8bf9-76a41922dfcc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:38.893501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb119f4-fbf3-497b-8bf9-76a41922dfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:38.911716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:38.968398 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4cb119f4-fbf3-497b-8bf9-76a41922dfcc None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:38.969609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4cb119f4-fbf3-497b-8bf9-76a41922dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:39.063061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:39.214835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a8e95-21d3-4b05-99f3-7b43d6fd041c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:39.216413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-937a8e95-21d3-4b05-99f3-7b43d6fd041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:39.330028 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:39.366068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a8e95-21d3-4b05-99f3-7b43d6fd041c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:39.477986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76745ee7-206d-4d7f-9855-49dc4bc0e7a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:39.478633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745ee7-206d-4d7f-9855-49dc4bc0e7a8 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:39.478916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745ee7-206d-4d7f-9855-49dc4bc0e7a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:39.479191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76745ee7-206d-4d7f-9855-49dc4bc0e7a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:39.480871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-76745ee7-206d-4d7f-9855-49dc4bc0e7a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:39.556596 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:39.570597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76745ee7-206d-4d7f-9855-49dc4bc0e7a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:39.572235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76745ee7-206d-4d7f-9855-49dc4bc0e7a8 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:39.591746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 707/1425] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:40.461854 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623ccd7-5ce4-4206-bcb8-296acc96b191 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:40.462513 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623ccd7-5ce4-4206-bcb8-296acc96b191 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:40.462971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1623ccd7-5ce4-4206-bcb8-296acc96b191 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:40.465073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:02:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:40.472991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f759-d3de-4a80-a668-fc922ba785d2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:40.473588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f759-d3de-4a80-a668-fc922ba785d2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:40.473588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e3f759-d3de-4a80-a668-fc922ba785d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:40.549935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f7e3f759-d3de-4a80-a668-fc922ba785d2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:40.551065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f7e3f759-d3de-4a80-a668-fc922ba785d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:40.647558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:02:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:02:40.802494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623ccd7-5ce4-4206-bcb8-296acc96b191 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:40.804004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1623ccd7-5ce4-4206-bcb8-296acc96b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:40.891662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:40.954927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1623ccd7-5ce4-4206-bcb8-296acc96b191 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:41.067191 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1136020-252a-47d3-80f5-2b9bce4053d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:41.067753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1136020-252a-47d3-80f5-2b9bce4053d5 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:41.068063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1136020-252a-47d3-80f5-2b9bce4053d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:41.068343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1136020-252a-47d3-80f5-2b9bce4053d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:41.069993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e1136020-252a-47d3-80f5-2b9bce4053d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:41.118731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:41.162384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1136020-252a-47d3-80f5-2b9bce4053d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:41.164017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1136020-252a-47d3-80f5-2b9bce4053d5 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:41.182733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 720/1428] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:42.073642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad0d8-bddc-42fe-92c3-091402a6d301 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:42.074198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad0d8-bddc-42fe-92c3-091402a6d301 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:42.074198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ad0d8-bddc-42fe-92c3-091402a6d301 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:42.075564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:42.080958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6bdb5-47f2-482e-92ff-21f019f095ce None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:42.081388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6bdb5-47f2-482e-92ff-21f019f095ce None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:42.081507 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e6bdb5-47f2-482e-92ff-21f019f095ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:42.156424 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-78e6bdb5-47f2-482e-92ff-21f019f095ce None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:42.157637 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-78e6bdb5-47f2-482e-92ff-21f019f095ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:42.254454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:02:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:42.410277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ad0d8-bddc-42fe-92c3-091402a6d301 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:42.411837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-751ad0d8-bddc-42fe-92c3-091402a6d301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:42.461060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:42.562896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ad0d8-bddc-42fe-92c3-091402a6d301 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:42.675691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b22e3-ee46-4d68-9db5-39729dcd70e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:42.676371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b22e3-ee46-4d68-9db5-39729dcd70e9 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:42.676656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b22e3-ee46-4d68-9db5-39729dcd70e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:42.676931 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b22e3-ee46-4d68-9db5-39729dcd70e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:42.678608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-113b22e3-ee46-4d68-9db5-39729dcd70e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:42.686070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:42.769360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b22e3-ee46-4d68-9db5-39729dcd70e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:42.771098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b22e3-ee46-4d68-9db5-39729dcd70e9 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:42.791762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 710/1431] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:43.685586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150785-6d37-48eb-a741-aafcca19f2f8 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:43.686244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150785-6d37-48eb-a741-aafcca19f2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:43.686396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92150785-6d37-48eb-a741-aafcca19f2f8 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:43.687795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:02:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:43.692934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0ecb-51c7-43d1-915c-bc2d915b620c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:43.693368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0ecb-51c7-43d1-915c-bc2d915b620c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:43.693493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46c0ecb-51c7-43d1-915c-bc2d915b620c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:43.769656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d46c0ecb-51c7-43d1-915c-bc2d915b620c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:43.770988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d46c0ecb-51c7-43d1-915c-bc2d915b620c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:43.838792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:43.868984 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:02:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:44.020299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150785-6d37-48eb-a741-aafcca19f2f8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:44.021796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-92150785-6d37-48eb-a741-aafcca19f2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:44.039867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:44.167661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92150785-6d37-48eb-a741-aafcca19f2f8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:44.255326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:44.281065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1373f13-5a31-4ba7-9eaf-ac470b4c06eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:44.282000 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1373f13-5a31-4ba7-9eaf-ac470b4c06eb service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:44.282283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1373f13-5a31-4ba7-9eaf-ac470b4c06eb service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:44.282560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1373f13-5a31-4ba7-9eaf-ac470b4c06eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:44.284252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c1373f13-5a31-4ba7-9eaf-ac470b4c06eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:44.374571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1373f13-5a31-4ba7-9eaf-ac470b4c06eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:44.376311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1373f13-5a31-4ba7-9eaf-ac470b4c06eb service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:44.395002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 723/1434] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:45.290660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff087d-ffa7-414b-813f-5bdef89eb509 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:45.291155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff087d-ffa7-414b-813f-5bdef89eb509 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:45.291263 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff087d-ffa7-414b-813f-5bdef89eb509 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:45.292610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:45.298175 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e70e76-5a0f-4d90-aab9-a372782a47c4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:45.298615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e70e76-5a0f-4d90-aab9-a372782a47c4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:45.298724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e70e76-5a0f-4d90-aab9-a372782a47c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:45.373609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-89e70e76-5a0f-4d90-aab9-a372782a47c4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:45.374818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-89e70e76-5a0f-4d90-aab9-a372782a47c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:45.415777 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:45.472235 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:02:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:45.621414 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff087d-ffa7-414b-813f-5bdef89eb509 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:45.623394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-53ff087d-ffa7-414b-813f-5bdef89eb509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:45.772792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff087d-ffa7-414b-813f-5bdef89eb509 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:45.829079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:45.892720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc40a14-cfc8-46c0-a64a-99e7144520f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:45.893342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc40a14-cfc8-46c0-a64a-99e7144520f9 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:45.893641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc40a14-cfc8-46c0-a64a-99e7144520f9 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:45.893944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc40a14-cfc8-46c0-a64a-99e7144520f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:45.895742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9fc40a14-cfc8-46c0-a64a-99e7144520f9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:45.985949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc40a14-cfc8-46c0-a64a-99e7144520f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:45.987620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc40a14-cfc8-46c0-a64a-99e7144520f9 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:46.005726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 713/1437] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:46.886119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac28969-c02f-4e64-b1f3-71f9878796e7 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:46.886707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac28969-c02f-4e64-b1f3-71f9878796e7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:46.886707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac28969-c02f-4e64-b1f3-71f9878796e7 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:46.888924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:46.893728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4909b2-ce03-4e99-ada7-08fac30ba0fa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:46.894197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4909b2-ce03-4e99-ada7-08fac30ba0fa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:46.894327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4909b2-ce03-4e99-ada7-08fac30ba0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:46.971951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6a4909b2-ce03-4e99-ada7-08fac30ba0fa None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:46.973162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6a4909b2-ce03-4e99-ada7-08fac30ba0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:46.975161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:47.069904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:02:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:47.220738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac28969-c02f-4e64-b1f3-71f9878796e7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:47.222296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6ac28969-c02f-4e64-b1f3-71f9878796e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:47.372136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac28969-c02f-4e64-b1f3-71f9878796e7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:47.400099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:47.488020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302c9cf-f688-486a-981c-013e2dff1d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:47.488581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c9cf-f688-486a-981c-013e2dff1d91 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:47.488859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c9cf-f688-486a-981c-013e2dff1d91 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:47.489132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302c9cf-f688-486a-981c-013e2dff1d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:47.490756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b302c9cf-f688-486a-981c-013e2dff1d91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:47.577824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302c9cf-f688-486a-981c-013e2dff1d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:47.579406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302c9cf-f688-486a-981c-013e2dff1d91 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:47.597213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 726/1440] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:49.571912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b7495-8bf9-4029-80aa-cfcb5a8af998 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:49.572458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b7495-8bf9-4029-80aa-cfcb5a8af998 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:49.572458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b7495-8bf9-4029-80aa-cfcb5a8af998 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:49.573842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:49.579239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447de4-236b-4a05-ac1a-c7ec483aa4b8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:49.579656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447de4-236b-4a05-ac1a-c7ec483aa4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:49.579784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c447de4-236b-4a05-ac1a-c7ec483aa4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:49.619036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:49.644353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4c447de4-236b-4a05-ac1a-c7ec483aa4b8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:49.645575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4c447de4-236b-4a05-ac1a-c7ec483aa4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:49.743581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:02:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:49.783692 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b7495-8bf9-4029-80aa-cfcb5a8af998 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:49.785271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9e9b7495-8bf9-4029-80aa-cfcb5a8af998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:49.886319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9b7495-8bf9-4029-80aa-cfcb5a8af998 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:49.919996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:49.962301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3575102-ea1d-4a9f-8800-c062b14a0d8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:49.962948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3575102-ea1d-4a9f-8800-c062b14a0d8b service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:49.963230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3575102-ea1d-4a9f-8800-c062b14a0d8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:49.963506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3575102-ea1d-4a9f-8800-c062b14a0d8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:49.965182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b3575102-ea1d-4a9f-8800-c062b14a0d8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:50.072976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3575102-ea1d-4a9f-8800-c062b14a0d8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:50.074425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3575102-ea1d-4a9f-8800-c062b14a0d8b service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:50.092754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 716/1443] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:52.366800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839b52d-f6e1-4f1a-9a18-3dba450f12ce None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:52.367555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839b52d-f6e1-4f1a-9a18-3dba450f12ce None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:52.367555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839b52d-f6e1-4f1a-9a18-3dba450f12ce None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:52.369059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:02:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:52.375333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16ea2-66c5-4080-b027-066e41c4983e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:52.375769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16ea2-66c5-4080-b027-066e41c4983e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:52.375943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b16ea2-66c5-4080-b027-066e41c4983e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:52.443295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c0b16ea2-66c5-4080-b027-066e41c4983e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:52.444521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c0b16ea2-66c5-4080-b027-066e41c4983e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:52.457767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:52.540827 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:02:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:02:52.579421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839b52d-f6e1-4f1a-9a18-3dba450f12ce None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:52.581004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6839b52d-f6e1-4f1a-9a18-3dba450f12ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:52.687112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839b52d-f6e1-4f1a-9a18-3dba450f12ce None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:52.699087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:52.760310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8736abd6-c0b8-43e0-bb77-511521e5bf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:52.760956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736abd6-c0b8-43e0-bb77-511521e5bf64 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:52.761237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736abd6-c0b8-43e0-bb77-511521e5bf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:52.761508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8736abd6-c0b8-43e0-bb77-511521e5bf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:52.763381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8736abd6-c0b8-43e0-bb77-511521e5bf64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:52.873379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736abd6-c0b8-43e0-bb77-511521e5bf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:52.874791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8736abd6-c0b8-43e0-bb77-511521e5bf64 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:52.892467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 729/1446] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:55.393962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556e1f0-422e-48e2-8fbf-0a80c2ce9a86 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:55.394526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556e1f0-422e-48e2-8fbf-0a80c2ce9a86 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:55.394526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e556e1f0-422e-48e2-8fbf-0a80c2ce9a86 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:55.395940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:55.401298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0707d1-01c0-459c-b46f-931b05566549 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:55.401713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0707d1-01c0-459c-b46f-931b05566549 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:55.401837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0707d1-01c0-459c-b46f-931b05566549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:55.454914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:55.472516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-eb0707d1-01c0-459c-b46f-931b05566549 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:55.473742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eb0707d1-01c0-459c-b46f-931b05566549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:55.573066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:55.614152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556e1f0-422e-48e2-8fbf-0a80c2ce9a86 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:55.615729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e556e1f0-422e-48e2-8fbf-0a80c2ce9a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:55.722314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e556e1f0-422e-48e2-8fbf-0a80c2ce9a86 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:55.763898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:55.797761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f2772-95e5-49d2-b051-42d7b5e73285 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:55.798408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f2772-95e5-49d2-b051-42d7b5e73285 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:55.798712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f2772-95e5-49d2-b051-42d7b5e73285 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:55.798986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f2772-95e5-49d2-b051-42d7b5e73285 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:55.800683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-893f2772-95e5-49d2-b051-42d7b5e73285 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:55.910862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f2772-95e5-49d2-b051-42d7b5e73285 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:55.912332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f2772-95e5-49d2-b051-42d7b5e73285 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:55.931843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 719/1449] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:02:58.147148 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff60be8-95e1-43f6-89c9-d2174e29e6fd None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:58.147735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff60be8-95e1-43f6-89c9-d2174e29e6fd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:58.147735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff60be8-95e1-43f6-89c9-d2174e29e6fd None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:58.149152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:02:58.154952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce89bed-d06f-46c8-8091-e302f857f9e2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:58.155383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce89bed-d06f-46c8-8091-e302f857f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:58.155506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce89bed-d06f-46c8-8091-e302f857f9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:58.226125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2ce89bed-d06f-46c8-8091-e302f857f9e2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:02:58.227350 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2ce89bed-d06f-46c8-8091-e302f857f9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:58.249552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:58.331548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:02:58.370362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff60be8-95e1-43f6-89c9-d2174e29e6fd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:02:58.372521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5ff60be8-95e1-43f6-89c9-d2174e29e6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:58.474185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff60be8-95e1-43f6-89c9-d2174e29e6fd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:02:58.493715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:02:58.548241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e8820-6dcc-4cad-b8d4-210b6182614f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:02:58.548886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8820-6dcc-4cad-b8d4-210b6182614f service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:02:58.549164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8820-6dcc-4cad-b8d4-210b6182614f service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:02:58.549435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e8820-6dcc-4cad-b8d4-210b6182614f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:02:58.551090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c09e8820-6dcc-4cad-b8d4-210b6182614f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:02:58.666629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e8820-6dcc-4cad-b8d4-210b6182614f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:02:58.668094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09e8820-6dcc-4cad-b8d4-210b6182614f service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:02:58.687528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 732/1452] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:00.801246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580a068-9291-424f-b443-92b8919d7e24 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:00.801838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580a068-9291-424f-b443-92b8919d7e24 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:00.801838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2580a068-9291-424f-b443-92b8919d7e24 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:00.803185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:00.808606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47aeb5-fa13-4192-88b5-32239eb0d487 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:00.809034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47aeb5-fa13-4192-88b5-32239eb0d487 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:00.809735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f47aeb5-fa13-4192-88b5-32239eb0d487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:00.871332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:00.874115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7f47aeb5-fa13-4192-88b5-32239eb0d487 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:00.875328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7f47aeb5-fa13-4192-88b5-32239eb0d487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:00.975425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:03:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:01.015123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580a068-9291-424f-b443-92b8919d7e24 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:01.016719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2580a068-9291-424f-b443-92b8919d7e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:01.122209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2580a068-9291-424f-b443-92b8919d7e24 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:01.172212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:01.196398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a839c3-77e4-4425-80da-ab6823dad454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:01.197042 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a839c3-77e4-4425-80da-ab6823dad454 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:01.197319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a839c3-77e4-4425-80da-ab6823dad454 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:01.197617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a839c3-77e4-4425-80da-ab6823dad454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:01.199273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-79a839c3-77e4-4425-80da-ab6823dad454 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:01.308593 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a839c3-77e4-4425-80da-ab6823dad454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:01.310671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a839c3-77e4-4425-80da-ab6823dad454 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:01.330443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 722/1455] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:03.451703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f4a6f-d967-4816-adc5-751caa3e5a02 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:03.452302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f4a6f-d967-4816-adc5-751caa3e5a02 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:03.452302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f4a6f-d967-4816-adc5-751caa3e5a02 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:03.453687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:03.459012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f482801-e127-4394-93b3-3510d5e31a46 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:03.459443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f482801-e127-4394-93b3-3510d5e31a46 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:03.459561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f482801-e127-4394-93b3-3510d5e31a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:03.524140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3f482801-e127-4394-93b3-3510d5e31a46 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:03.525280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3f482801-e127-4394-93b3-3510d5e31a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:03.555876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:03.624945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:03.664607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f4a6f-d967-4816-adc5-751caa3e5a02 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:03.666143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf1f4a6f-d967-4816-adc5-751caa3e5a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:03.773295 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f4a6f-d967-4816-adc5-751caa3e5a02 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:03.803075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:03.848184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d1e62a-639c-47ff-be31-b1d457180f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:03.848846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e62a-639c-47ff-be31-b1d457180f7b service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:03.849130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e62a-639c-47ff-be31-b1d457180f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:03.849425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d1e62a-639c-47ff-be31-b1d457180f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:03.851079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-98d1e62a-639c-47ff-be31-b1d457180f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:03.963146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1e62a-639c-47ff-be31-b1d457180f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:03.964625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d1e62a-639c-47ff-be31-b1d457180f7b service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:03.984374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 735/1458] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:06.114818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977e50-59cf-4759-b3d9-69dba6c0088f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:06.115401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977e50-59cf-4759-b3d9-69dba6c0088f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:06.115401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a977e50-59cf-4759-b3d9-69dba6c0088f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:06.116810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:03:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:06.122193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dcb35-3d33-44c6-bb0f-fdcea7e8d5e3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:06.122712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dcb35-3d33-44c6-bb0f-fdcea7e8d5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:06.122712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8dcb35-3d33-44c6-bb0f-fdcea7e8d5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:06.189216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3e8dcb35-3d33-44c6-bb0f-fdcea7e8d5e3 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:06.190437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3e8dcb35-3d33-44c6-bb0f-fdcea7e8d5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:06.198872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:06.289733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:03:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:06.328270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a977e50-59cf-4759-b3d9-69dba6c0088f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:06.329799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7a977e50-59cf-4759-b3d9-69dba6c0088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:06.435147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a977e50-59cf-4759-b3d9-69dba6c0088f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:06.491281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:06.510433 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb853f19-5e07-4f74-908c-25ddf64e3abb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:06.515988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb853f19-5e07-4f74-908c-25ddf64e3abb service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:06.515988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb853f19-5e07-4f74-908c-25ddf64e3abb service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:06.515988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb853f19-5e07-4f74-908c-25ddf64e3abb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:06.515988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bb853f19-5e07-4f74-908c-25ddf64e3abb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:06.624110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb853f19-5e07-4f74-908c-25ddf64e3abb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:06.625612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb853f19-5e07-4f74-908c-25ddf64e3abb service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:06.644249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 725/1461] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:08.829350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5f31a-7edc-4b24-9da6-a2e78b25e473 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:08.829968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5f31a-7edc-4b24-9da6-a2e78b25e473 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:08.829968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf5f31a-7edc-4b24-9da6-a2e78b25e473 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:08.831279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:08.836538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519493d-1a45-4a1f-8718-8c10730333b4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:08.837001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519493d-1a45-4a1f-8718-8c10730333b4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:08.837113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4519493d-1a45-4a1f-8718-8c10730333b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:08.900456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4519493d-1a45-4a1f-8718-8c10730333b4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:08.901647 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4519493d-1a45-4a1f-8718-8c10730333b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:08.940452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:08.999632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:09.037289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5f31a-7edc-4b24-9da6-a2e78b25e473 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:09.038858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1bf5f31a-7edc-4b24-9da6-a2e78b25e473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:09.143086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf5f31a-7edc-4b24-9da6-a2e78b25e473 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:09.180180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:09.216662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb9938a-a31f-4e18-8531-9500ea0d3a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:09.217306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9938a-a31f-4e18-8531-9500ea0d3a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:09.217586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9938a-a31f-4e18-8531-9500ea0d3a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:09.217896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb9938a-a31f-4e18-8531-9500ea0d3a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:09.220310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7fb9938a-a31f-4e18-8531-9500ea0d3a53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:09.328490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9938a-a31f-4e18-8531-9500ea0d3a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:09.329937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb9938a-a31f-4e18-8531-9500ea0d3a53 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:09.348991 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 738/1464] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:11.404533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d838ddc-8178-472c-8f22-d35c35a2079b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:11.405123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d838ddc-8178-472c-8f22-d35c35a2079b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:11.405123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d838ddc-8178-472c-8f22-d35c35a2079b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:11.406469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:11.412351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682423bb-21de-4d2d-9714-dc7ff9e2dfd2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:11.412760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682423bb-21de-4d2d-9714-dc7ff9e2dfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:11.412915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682423bb-21de-4d2d-9714-dc7ff9e2dfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:11.477858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-682423bb-21de-4d2d-9714-dc7ff9e2dfd2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:11.479131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-682423bb-21de-4d2d-9714-dc7ff9e2dfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:11.496780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:11.581398 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:11.618925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d838ddc-8178-472c-8f22-d35c35a2079b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:11.620483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2d838ddc-8178-472c-8f22-d35c35a2079b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:11.727094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d838ddc-8178-472c-8f22-d35c35a2079b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:11.795947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:11.802756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ba9bee-1d4d-4911-803b-bf4b6cec8d1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:11.814085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9bee-1d4d-4911-803b-bf4b6cec8d1c service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:11.814085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9bee-1d4d-4911-803b-bf4b6cec8d1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:11.814085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba9bee-1d4d-4911-803b-bf4b6cec8d1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:11.814085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e8ba9bee-1d4d-4911-803b-bf4b6cec8d1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:11.921622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba9bee-1d4d-4911-803b-bf4b6cec8d1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:11.923005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ba9bee-1d4d-4911-803b-bf4b6cec8d1c service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:11.942873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 728/1467] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:14.015181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7668-d24c-41c7-923a-11ef1201ee13 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:14.015738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7668-d24c-41c7-923a-11ef1201ee13 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:14.015738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e7668-d24c-41c7-923a-11ef1201ee13 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:14.017122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:14.022325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae432f2b-dd1f-4c48-9912-d3c1e744e77d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:14.022774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae432f2b-dd1f-4c48-9912-d3c1e744e77d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:14.022946 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae432f2b-dd1f-4c48-9912-d3c1e744e77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:14.089502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ae432f2b-dd1f-4c48-9912-d3c1e744e77d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:14.091445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ae432f2b-dd1f-4c48-9912-d3c1e744e77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:14.140539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:14.190112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:14.228838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e7668-d24c-41c7-923a-11ef1201ee13 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:14.230408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7f8e7668-d24c-41c7-923a-11ef1201ee13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:14.335938 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e7668-d24c-41c7-923a-11ef1201ee13 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:14.384450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:14.412461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165df836-e0cb-4d62-ba71-ea82146d2d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:14.412998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165df836-e0cb-4d62-ba71-ea82146d2d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:14.413513 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165df836-e0cb-4d62-ba71-ea82146d2d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:14.413919 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165df836-e0cb-4d62-ba71-ea82146d2d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:14.416135 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-165df836-e0cb-4d62-ba71-ea82146d2d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:14.525168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165df836-e0cb-4d62-ba71-ea82146d2d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:14.526594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165df836-e0cb-4d62-ba71-ea82146d2d54 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:14.546018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 741/1470] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:24.196254 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=22 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:24.543453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=66 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:34.539873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f4400-17f6-420b-ac8b-b82f620dcd62 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:34.540455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f4400-17f6-420b-ac8b-b82f620dcd62 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:34.540455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f4400-17f6-420b-ac8b-b82f620dcd62 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:34.541832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 730/1471] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:34.547478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496cfe5-1b5e-43a6-8279-7927e5b06043 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:34.547936 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496cfe5-1b5e-43a6-8279-7927e5b06043 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:34.548095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496cfe5-1b5e-43a6-8279-7927e5b06043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:34.613531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b496cfe5-1b5e-43a6-8279-7927e5b06043 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:34.614757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b496cfe5-1b5e-43a6-8279-7927e5b06043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:34.713330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 742/1472] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:03:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:34.799797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d1153-e1da-4129-b989-ab2ab6550aba None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:34.800120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d1153-e1da-4129-b989-ab2ab6550aba None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:34.800406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d1153-e1da-4129-b989-ab2ab6550aba None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:34.801793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 731/1473] 10.222.0.85 () {54 vars in 966 bytes} [Wed Jul 20 22:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:34.806639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d8f2f-d210-4404-a090-5a026880bf3e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:34.806929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d8f2f-d210-4404-a090-5a026880bf3e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:34.807208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2d8f2f-d210-4404-a090-5a026880bf3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:34.880579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3b2d8f2f-d210-4404-a090-5a026880bf3e None None] MFA Rules not processed for user `2169b05e64224f69bcc1d9ce912a60e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:34.881788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3b2d8f2f-d210-4404-a090-5a026880bf3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:34.901780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:34.957914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 743/1474] 10.222.0.85 () {58 vars in 1063 bytes} [Wed Jul 20 22:03:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:34.966166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d1153-e1da-4129-b989-ab2ab6550aba None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:34.967633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-046d1153-e1da-4129-b989-ab2ab6550aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:35.072580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d1153-e1da-4129-b989-ab2ab6550aba None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:35.147871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9bef7-09b6-4019-9cba-a9de683e7b1e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2169b05e64224f69bcc1d9ce912a60e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:35.148541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9bef7-09b6-4019-9cba-a9de683e7b1e service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:35.148869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9bef7-09b6-4019-9cba-a9de683e7b1e service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:35.149144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9bef7-09b6-4019-9cba-a9de683e7b1e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:35.150788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2fe9bef7-09b6-4019-9cba-a9de683e7b1e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:35.206512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:35.262919 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9bef7-09b6-4019-9cba-a9de683e7b1e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:35.264405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9bef7-09b6-4019-9cba-a9de683e7b1e service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:35.283884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 732/1475] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:37.417470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7310bc-f6bb-4470-8c2a-f43335b77876 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:37.418254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7310bc-f6bb-4470-8c2a-f43335b77876 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:37.418254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7310bc-f6bb-4470-8c2a-f43335b77876 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:37.419873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 744/1476] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:37.425345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4dfa5-91e9-4ec7-a288-343882a3e6e7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:37.425760 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4dfa5-91e9-4ec7-a288-343882a3e6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:37.425908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e4dfa5-91e9-4ec7-a288-343882a3e6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:37.495366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f9e4dfa5-91e9-4ec7-a288-343882a3e6e7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:37.497164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f9e4dfa5-91e9-4ec7-a288-343882a3e6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:37.593671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 733/1477] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:37.617025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7310bc-f6bb-4470-8c2a-f43335b77876 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:37.618544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ba7310bc-f6bb-4470-8c2a-f43335b77876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:37.752515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7310bc-f6bb-4470-8c2a-f43335b77876 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:37.800997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:37.846600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0630e69-8581-4a23-8949-5861a417f046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:37.847166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630e69-8581-4a23-8949-5861a417f046 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:37.847573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630e69-8581-4a23-8949-5861a417f046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:37.847852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0630e69-8581-4a23-8949-5861a417f046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:37.848608 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0630e69-8581-4a23-8949-5861a417f046 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:37.850393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-d0630e69-8581-4a23-8949-5861a417f046 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:03:37.850393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: warnings.warn(msg) Jul 20 22:03:37.850393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: Jul 20 22:03:37.851525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0630e69-8581-4a23-8949-5861a417f046 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:37.872822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 745/1478] 10.222.0.85 () {56 vars in 1108 bytes} [Wed Jul 20 22:03:37 2022] GET /identity/v3/projects => generated 2553 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:03:40.010164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73749d6-8e48-4769-8638-310c93b7e177 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:40.010728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73749d6-8e48-4769-8638-310c93b7e177 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:40.010728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73749d6-8e48-4769-8638-310c93b7e177 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:40.012968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 734/1479] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:03:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:40.018441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b43a-6647-4e70-81fc-bf7095ab69a2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:40.018888 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b43a-6647-4e70-81fc-bf7095ab69a2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:40.019026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5b43a-6647-4e70-81fc-bf7095ab69a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:40.084155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-cef5b43a-6647-4e70-81fc-bf7095ab69a2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:40.085478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cef5b43a-6647-4e70-81fc-bf7095ab69a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:40.184987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 746/1480] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:03:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:40.228442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73749d6-8e48-4769-8638-310c93b7e177 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:40.230021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b73749d6-8e48-4769-8638-310c93b7e177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:40.239755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:40.378957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73749d6-8e48-4769-8638-310c93b7e177 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:40.463241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:40.496424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721751c6-ffa0-47d7-afa9-db3c3b91fe56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:40.497090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721751c6-ffa0-47d7-afa9-db3c3b91fe56 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:40.497373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721751c6-ffa0-47d7-afa9-db3c3b91fe56 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:40.497645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721751c6-ffa0-47d7-afa9-db3c3b91fe56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:40.499339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-721751c6-ffa0-47d7-afa9-db3c3b91fe56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:40.606730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721751c6-ffa0-47d7-afa9-db3c3b91fe56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:40.608416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721751c6-ffa0-47d7-afa9-db3c3b91fe56 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:40.626973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 735/1481] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:42.861012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fe07f-ec66-4999-9567-ea94a52bea4c None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:42.861688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fe07f-ec66-4999-9567-ea94a52bea4c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:42.861688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8fe07f-ec66-4999-9567-ea94a52bea4c None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:42.862918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 747/1482] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:42.868154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22796b-8133-4b3d-9816-d14e0a3f71d8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:42.868563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22796b-8133-4b3d-9816-d14e0a3f71d8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:42.868747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22796b-8133-4b3d-9816-d14e0a3f71d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:42.932803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9c22796b-8133-4b3d-9816-d14e0a3f71d8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:42.934245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9c22796b-8133-4b3d-9816-d14e0a3f71d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:42.981056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:43.031860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 736/1483] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:03:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:43.069946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fe07f-ec66-4999-9567-ea94a52bea4c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:43.071468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9f8fe07f-ec66-4999-9567-ea94a52bea4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:43.094614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:43.180545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8fe07f-ec66-4999-9567-ea94a52bea4c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:43.256462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45709106-e437-4726-8a3e-056b48b38516 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:43.257108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45709106-e437-4726-8a3e-056b48b38516 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:43.257389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45709106-e437-4726-8a3e-056b48b38516 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:43.257665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45709106-e437-4726-8a3e-056b48b38516 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:43.259315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-45709106-e437-4726-8a3e-056b48b38516 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:43.334947 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:43.372431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45709106-e437-4726-8a3e-056b48b38516 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:43.374255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45709106-e437-4726-8a3e-056b48b38516 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:43.396078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 748/1484] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:45.486332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9f8a8-beb8-4893-a06e-e9002800eb07 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:45.486901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9f8a8-beb8-4893-a06e-e9002800eb07 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:45.486901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9f8a8-beb8-4893-a06e-e9002800eb07 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:45.488283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 737/1485] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:45.493375 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c936e1-8f28-487b-9d92-6f659a5746d2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:45.493832 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c936e1-8f28-487b-9d92-6f659a5746d2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:45.493930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c936e1-8f28-487b-9d92-6f659a5746d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:45.679637 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-85c936e1-8f28-487b-9d92-6f659a5746d2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:45.680835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-85c936e1-8f28-487b-9d92-6f659a5746d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:45.781095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 749/1486] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:45.820881 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9f8a8-beb8-4893-a06e-e9002800eb07 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:45.822408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-50b9f8a8-beb8-4893-a06e-e9002800eb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:45.926386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9f8a8-beb8-4893-a06e-e9002800eb07 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:46.001045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:46.003351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b85cf8-6868-470c-a095-74003e9453b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:46.003565 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b85cf8-6868-470c-a095-74003e9453b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:46.003841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b85cf8-6868-470c-a095-74003e9453b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:46.004177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b85cf8-6868-470c-a095-74003e9453b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:46.005844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d1b85cf8-6868-470c-a095-74003e9453b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:46.118056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b85cf8-6868-470c-a095-74003e9453b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:46.119650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b85cf8-6868-470c-a095-74003e9453b2 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:46.140067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 738/1487] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:48.392234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7211a-0df8-4973-9427-92f2124251d1 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:48.392798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7211a-0df8-4973-9427-92f2124251d1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:48.392798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7211a-0df8-4973-9427-92f2124251d1 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:48.394168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 750/1488] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:48.399331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d27e-0084-4fbe-a44b-3089ca0fca6b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:48.399759 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d27e-0084-4fbe-a44b-3089ca0fca6b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:48.399877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa5d27e-0084-4fbe-a44b-3089ca0fca6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:48.467422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7aa5d27e-0084-4fbe-a44b-3089ca0fca6b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:48.468687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7aa5d27e-0084-4fbe-a44b-3089ca0fca6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:48.523535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:48.569401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 739/1489] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:48.611408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7211a-0df8-4973-9427-92f2124251d1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:48.612999 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e1c7211a-0df8-4973-9427-92f2124251d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:48.648462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:48.717556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7211a-0df8-4973-9427-92f2124251d1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:48.791800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd954da-fc6c-46a0-8d8c-90fbd052805c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:48.792531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd954da-fc6c-46a0-8d8c-90fbd052805c service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:48.792810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd954da-fc6c-46a0-8d8c-90fbd052805c service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:48.793267 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd954da-fc6c-46a0-8d8c-90fbd052805c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:48.794945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ccd954da-fc6c-46a0-8d8c-90fbd052805c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:48.874074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:48.905655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd954da-fc6c-46a0-8d8c-90fbd052805c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:48.907351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd954da-fc6c-46a0-8d8c-90fbd052805c service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:48.926451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 751/1490] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:03:51.521717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0e64f-be1d-42cb-9d9e-e0dd7fe8f7ea None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:51.522272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0e64f-be1d-42cb-9d9e-e0dd7fe8f7ea None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:51.522272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0e64f-be1d-42cb-9d9e-e0dd7fe8f7ea None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:51.523651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 740/1491] 10.222.0.85 () {54 vars in 926 bytes} [Wed Jul 20 22:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:03:51.529409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208feabd-08c2-4ad0-be5f-b57f3233424e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:51.529866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208feabd-08c2-4ad0-be5f-b57f3233424e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:51.529976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208feabd-08c2-4ad0-be5f-b57f3233424e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:51.599818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-208feabd-08c2-4ad0-be5f-b57f3233424e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:03:51.600976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-208feabd-08c2-4ad0-be5f-b57f3233424e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:51.697243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 752/1492] 10.222.0.85 () {58 vars in 1023 bytes} [Wed Jul 20 22:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:03:51.737227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0e64f-be1d-42cb-9d9e-e0dd7fe8f7ea None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:03:51.738750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-47c0e64f-be1d-42cb-9d9e-e0dd7fe8f7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:51.852858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0e64f-be1d-42cb-9d9e-e0dd7fe8f7ea None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:03:51.928396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf92037-dd98-49a1-aad6-0b614c8d7129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:03:51.929040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92037-dd98-49a1-aad6-0b614c8d7129 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:03:51.929318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92037-dd98-49a1-aad6-0b614c8d7129 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:03:51.929720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf92037-dd98-49a1-aad6-0b614c8d7129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:03:51.931354 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0bf92037-dd98-49a1-aad6-0b614c8d7129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:03:51.943230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:03:52.051322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf92037-dd98-49a1-aad6-0b614c8d7129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:03:52.052991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf92037-dd98-49a1-aad6-0b614c8d7129 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:03:52.072011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 741/1493] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:04:01.695512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=82 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:04:02.069683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=50 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:48.047571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b969-23b1-4b61-ae23-2bafa49fe9a9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:48.048210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b969-23b1-4b61-ae23-2bafa49fe9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:48.048210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3b969-23b1-4b61-ae23-2bafa49fe9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:48.128331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-34a3b969-23b1-4b61-ae23-2bafa49fe9a9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:05:48.129588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-34a3b969-23b1-4b61-ae23-2bafa49fe9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:05:48.240506 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 753/1494] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:05:48.249488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4238-864b-4884-a481-f2cfe60c2cf6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:48.250016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4238-864b-4884-a481-f2cfe60c2cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:48.250129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4238-864b-4884-a481-f2cfe60c2cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:48.269800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ab8a4238-864b-4884-a481-f2cfe60c2cf6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:05:48.271003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ab8a4238-864b-4884-a481-f2cfe60c2cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:05:48.280654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 742/1495] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:05:48.285588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3b969-23b1-4b61-ae23-2bafa49fe9a9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:05:48.295763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3b969-23b1-4b61-ae23-2bafa49fe9a9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:05:48.300303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f09f1b-99bf-4188-bd06-7d6aea298e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:05:48.300952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09f1b-99bf-4188-bd06-7d6aea298e8e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:48.301237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09f1b-99bf-4188-bd06-7d6aea298e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:48.301511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f09f1b-99bf-4188-bd06-7d6aea298e8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:48.302231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f09f1b-99bf-4188-bd06-7d6aea298e8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:05:48.302535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f09f1b-99bf-4188-bd06-7d6aea298e8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:05:48.303548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-a1f09f1b-99bf-4188-bd06-7d6aea298e8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:05:48.303548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: warnings.warn(msg) Jul 20 22:05:48.303548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: Jul 20 22:05:48.304453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f09f1b-99bf-4188-bd06-7d6aea298e8e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:05:48.315858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 754/1496] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:05:48.324952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4238-864b-4884-a481-f2cfe60c2cf6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:05:48.334297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4238-864b-4884-a481-f2cfe60c2cf6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:05:48.340521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71370877-23d8-4333-b888-a06f3830adb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:05:48.341295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71370877-23d8-4333-b888-a06f3830adb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:48.341493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71370877-23d8-4333-b888-a06f3830adb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:48.341773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71370877-23d8-4333-b888-a06f3830adb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:48.342475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71370877-23d8-4333-b888-a06f3830adb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:05:48.344346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-71370877-23d8-4333-b888-a06f3830adb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:05:48.344346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: warnings.warn(msg) Jul 20 22:05:48.344346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: Jul 20 22:05:48.345566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71370877-23d8-4333-b888-a06f3830adb1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:05:48.516802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 743/1497] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:05:48 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:05:48.520896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f09f1b-99bf-4188-bd06-7d6aea298e8e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:05:48.530967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f09f1b-99bf-4188-bd06-7d6aea298e8e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:05:48.581022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:48.587931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560c973-2969-4aa6-96d2-bdb5c5733e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:05:48.588840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560c973-2969-4aa6-96d2-bdb5c5733e6f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:48.589005 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560c973-2969-4aa6-96d2-bdb5c5733e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:48.589159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560c973-2969-4aa6-96d2-bdb5c5733e6f admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:48.589902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560c973-2969-4aa6-96d2-bdb5c5733e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:05:48.590920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-2560c973-2969-4aa6-96d2-bdb5c5733e6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:05:48.590920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: warnings.warn(msg) Jul 20 22:05:48.590920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: Jul 20 22:05:48.592128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560c973-2969-4aa6-96d2-bdb5c5733e6f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:05:48.715281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 755/1498] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:05:48 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:05:48.719495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71370877-23d8-4333-b888-a06f3830adb1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:05:48.730250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71370877-23d8-4333-b888-a06f3830adb1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:05:48.734957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e211cf-024a-4db7-bc77-4ea462506792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:05:48.735642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e211cf-024a-4db7-bc77-4ea462506792 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:48.735941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e211cf-024a-4db7-bc77-4ea462506792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:48.736215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e211cf-024a-4db7-bc77-4ea462506792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:48.736934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e211cf-024a-4db7-bc77-4ea462506792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:05:48.737949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-29e211cf-024a-4db7-bc77-4ea462506792 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:05:48.737949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: warnings.warn(msg) Jul 20 22:05:48.737949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: Jul 20 22:05:48.738845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e211cf-024a-4db7-bc77-4ea462506792 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:05:48.752724 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 744/1499] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:05:48.756805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560c973-2969-4aa6-96d2-bdb5c5733e6f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:05:48.767227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560c973-2969-4aa6-96d2-bdb5c5733e6f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:05:48.771694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fdc029-4e67-4c4c-93bf-a748bc13e088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:05:48.772390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdc029-4e67-4c4c-93bf-a748bc13e088 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:48.772684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdc029-4e67-4c4c-93bf-a748bc13e088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:48.772959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdc029-4e67-4c4c-93bf-a748bc13e088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:48.773696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdc029-4e67-4c4c-93bf-a748bc13e088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:05:48.774753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-78fdc029-4e67-4c4c-93bf-a748bc13e088 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:05:48.774753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: warnings.warn(msg) Jul 20 22:05:48.774753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: Jul 20 22:05:48.775611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fdc029-4e67-4c4c-93bf-a748bc13e088 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:05:48.789456 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 756/1500] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:05:48.794318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e211cf-024a-4db7-bc77-4ea462506792 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:05:48.804705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e211cf-024a-4db7-bc77-4ea462506792 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:05:48.810687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3d7b1-29fb-4261-8599-9af7e23ba068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:05:48.811598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3d7b1-29fb-4261-8599-9af7e23ba068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:48.811883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3d7b1-29fb-4261-8599-9af7e23ba068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:48.812198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3d7b1-29fb-4261-8599-9af7e23ba068 admin admin] PATH_INFO: `/v3/projects/7dbfd44c12b44994a3d00cf6ef0b8fb7/users/3aff32be1d09436b96e4ba7543dd29cf/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:48.827782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3d7b1-29fb-4261-8599-9af7e23ba068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dbfd44c12b44994a3d00cf6ef0b8fb7, user_id=3aff32be1d09436b96e4ba7543dd29cf, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:05:48.828865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-24e3d7b1-29fb-4261-8599-9af7e23ba068 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:05:48.828865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: warnings.warn(msg) Jul 20 22:05:48.828865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: Jul 20 22:05:48.830794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3d7b1-29fb-4261-8599-9af7e23ba068 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:05:48.914615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 745/1501] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:05:48 2022] PUT /identity/v3/projects/7dbfd44c12b44994a3d00cf6ef0b8fb7/users/3aff32be1d09436b96e4ba7543dd29cf/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:05:48.929182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80121cf-0b7e-4aca-ba9b-35e85d8db0bb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:48.929471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80121cf-0b7e-4aca-ba9b-35e85d8db0bb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:48.929809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80121cf-0b7e-4aca-ba9b-35e85d8db0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:48.960841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b80121cf-0b7e-4aca-ba9b-35e85d8db0bb None None] MFA Rules not processed for user `3aff32be1d09436b96e4ba7543dd29cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:05:48.962075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b80121cf-0b7e-4aca-ba9b-35e85d8db0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:05:49.027015 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 757/1502] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:05:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:05:49.040642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa772bfd-2534-4393-9dcc-22f12a6c8a02 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:49.040935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa772bfd-2534-4393-9dcc-22f12a6c8a02 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:49.041709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa772bfd-2534-4393-9dcc-22f12a6c8a02 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:49.043283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 746/1503] 10.222.0.85 () {54 vars in 964 bytes} [Wed Jul 20 22:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:05:49.048173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef5d3-3423-48db-9979-844a4b263798 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:49.048627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef5d3-3423-48db-9979-844a4b263798 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:49.048727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421ef5d3-3423-48db-9979-844a4b263798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:49.110688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-421ef5d3-3423-48db-9979-844a4b263798 None None] MFA Rules not processed for user `7153a137b4734df1a057d26509d53dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:05:49.111889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-421ef5d3-3423-48db-9979-844a4b263798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:05:49.188434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 758/1504] 10.222.0.85 () {58 vars in 1061 bytes} [Wed Jul 20 22:05:49 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:05:49.196228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa772bfd-2534-4393-9dcc-22f12a6c8a02 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:05:49.207703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa772bfd-2534-4393-9dcc-22f12a6c8a02 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:05:49.211431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966db48c-cee4-409e-9351-f413dca8dbd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:05:49.212161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966db48c-cee4-409e-9351-f413dca8dbd8 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:49.212448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966db48c-cee4-409e-9351-f413dca8dbd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:49.212724 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966db48c-cee4-409e-9351-f413dca8dbd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:49.221875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966db48c-cee4-409e-9351-f413dca8dbd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:05:49.222713 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966db48c-cee4-409e-9351-f413dca8dbd8 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:05:49.231602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 747/1505] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:05:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:05:49.275066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668217a-12e8-4451-bd7f-8ee2c5da7230 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:49.275356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668217a-12e8-4451-bd7f-8ee2c5da7230 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:49.275704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8668217a-12e8-4451-bd7f-8ee2c5da7230 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:49.277645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 759/1506] 10.222.0.85 () {52 vars in 829 bytes} [Wed Jul 20 22:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:05:49.281172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966db48c-cee4-409e-9351-f413dca8dbd8 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:05:49.344395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966db48c-cee4-409e-9351-f413dca8dbd8 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:05:49.349055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:05:49.349929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:49.350239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:49.350514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] PATH_INFO: `/v3/users/3aff32be1d09436b96e4ba7543dd29cf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:49.351751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3aff32be1d09436b96e4ba7543dd29cf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:05:49.352809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:05:49.352809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: warnings.warn(msg) Jul 20 22:05:49.352809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: Jul 20 22:05:49.354058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:05:49.583878 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3aff32be1d09436b96e4ba7543dd29cf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:05:49.601844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3aff32be1d09436b96e4ba7543dd29cf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:05:49.614520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3aff32be1d09436b96e4ba7543dd29cf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:05:49.615365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3aff32be1d09436b96e4ba7543dd29cf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:05:49.616001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3aff32be1d09436b96e4ba7543dd29cf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:05:49.620818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:49.760932 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 748/1507] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:05:49 2022] DELETE /identity/v3/users/3aff32be1d09436b96e4ba7543dd29cf => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:05:49.765416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c060-5d4e-42dc-831d-d966b2dcd715 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:49.765713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c060-5d4e-42dc-831d-d966b2dcd715 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:49.765990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6c060-5d4e-42dc-831d-d966b2dcd715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:49.785023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-28f6c060-5d4e-42dc-831d-d966b2dcd715 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:05:49.786239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-28f6c060-5d4e-42dc-831d-d966b2dcd715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:05:49.796053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:05:49.846194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 760/1508] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:05:49.857408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:05:49.860189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:05:49.937153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bf4f9-4c75-48e0-83ad-c69d58571644 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:05:49.940738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd2c61-ff91-4c84-9a66-16e344ec44b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:05:49.941382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd2c61-ff91-4c84-9a66-16e344ec44b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:49.941662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd2c61-ff91-4c84-9a66-16e344ec44b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:49.941934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd2c61-ff91-4c84-9a66-16e344ec44b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:49.952124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd2c61-ff91-4c84-9a66-16e344ec44b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:05:49.953561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fd2c61-ff91-4c84-9a66-16e344ec44b4 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:05:49.962972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 749/1509] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:05:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:05:50.499671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6c060-5d4e-42dc-831d-d966b2dcd715 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:05:50.504642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-28f6c060-5d4e-42dc-831d-d966b2dcd715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:05:50.514962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6c060-5d4e-42dc-831d-d966b2dcd715 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:05:50.520355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:05:50.521885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:05:50.521885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:05:50.521885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] PATH_INFO: `/v3/projects/7dbfd44c12b44994a3d00cf6ef0b8fb7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:05:50.522963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dbfd44c12b44994a3d00cf6ef0b8fb7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:05:50.524023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:05:50.524023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: warnings.warn(msg) Jul 20 22:05:50.524023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: Jul 20 22:05:50.525204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:05:50.685981 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dbfd44c12b44994a3d00cf6ef0b8fb7', 'request_id': 'req-f40ebb42-f780-4ab8-a507-7fbc8be54458'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:05:50.692108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dbfd44c12b44994a3d00cf6ef0b8fb7', 'request_id': 'req-f40ebb42-f780-4ab8-a507-7fbc8be54458'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:05:50.760716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dbfd44c12b44994a3d00cf6ef0b8fb7', 'request_id': 'req-f40ebb42-f780-4ab8-a507-7fbc8be54458'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:05:50.780422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] The token cache is being invalidate because project 7dbfd44c12b44994a3d00cf6ef0b8fb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:05:50.780712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:05:50.781605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f40ebb42-f780-4ab8-a507-7fbc8be54458 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:05:50.783498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 761/1510] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:05:50 2022] DELETE /identity/v3/projects/7dbfd44c12b44994a3d00cf6ef0b8fb7 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:05:59.958723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=1,keystone:SELECT=37 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:06:00.777144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:07:42.701703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbbcd-5086-4b26-9c82-77f23d5eabf0 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:42.702313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbbcd-5086-4b26-9c82-77f23d5eabf0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:42.702313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbbbcd-5086-4b26-9c82-77f23d5eabf0 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:42.703649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:07:42.708812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de48584-def5-4f01-8f55-223ad096326e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:42.709262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de48584-def5-4f01-8f55-223ad096326e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:42.709383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de48584-def5-4f01-8f55-223ad096326e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:42.727146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9de48584-def5-4f01-8f55-223ad096326e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:07:42.728399 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9de48584-def5-4f01-8f55-223ad096326e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:07:42.788741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:07:42.942571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbbbcd-5086-4b26-9c82-77f23d5eabf0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:07:42.944548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-68bbbbcd-5086-4b26-9c82-77f23d5eabf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:07:43.048732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbbbcd-5086-4b26-9c82-77f23d5eabf0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:07:43.054214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168df500-5cd1-410d-9dec-48ff5fa411e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:07:43.054854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168df500-5cd1-410d-9dec-48ff5fa411e8 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:43.055136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168df500-5cd1-410d-9dec-48ff5fa411e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:43.055417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168df500-5cd1-410d-9dec-48ff5fa411e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:43.063598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168df500-5cd1-410d-9dec-48ff5fa411e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:07:43.065220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168df500-5cd1-410d-9dec-48ff5fa411e8 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:07:43.074691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 751/1513] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:07:43.908601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd469500-3b2a-43b6-a569-c5b9658e6abc None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:43.909170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd469500-3b2a-43b6-a569-c5b9658e6abc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:43.909170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd469500-3b2a-43b6-a569-c5b9658e6abc None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:43.910779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:07:43.915687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a2ada-6444-4f7a-ae5b-717d1c19fd3d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:43.916155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a2ada-6444-4f7a-ae5b-717d1c19fd3d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:43.916323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6a2ada-6444-4f7a-ae5b-717d1c19fd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:43.934605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-af6a2ada-6444-4f7a-ae5b-717d1c19fd3d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:07:43.935815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-af6a2ada-6444-4f7a-ae5b-717d1c19fd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:07:43.943848 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:07:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:07:44.096032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd469500-3b2a-43b6-a569-c5b9658e6abc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:07:44.110181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd469500-3b2a-43b6-a569-c5b9658e6abc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:07:44.116006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff61e27-4f23-427b-b818-c816b20fb038 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:07:44.120104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff61e27-4f23-427b-b818-c816b20fb038 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:44.120104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff61e27-4f23-427b-b818-c816b20fb038 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:44.120104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff61e27-4f23-427b-b818-c816b20fb038 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:44.126338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff61e27-4f23-427b-b818-c816b20fb038 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:07:44.127968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff61e27-4f23-427b-b818-c816b20fb038 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:07:44.138319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 764/1516] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:07:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:07:44.765431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b67fb-f8ef-4b68-a1f7-04ff898d4d11 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:44.765716 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b67fb-f8ef-4b68-a1f7-04ff898d4d11 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:44.765991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b67fb-f8ef-4b68-a1f7-04ff898d4d11 None None] PATH_INFO: `/v3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:44.767305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 753/1517] 10.222.0.87 () {54 vars in 925 bytes} [Wed Jul 20 22:07:44 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:07:44.773948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d897-f65d-4efa-912c-296a5a19af22 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:44.774231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d897-f65d-4efa-912c-296a5a19af22 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:44.774505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41d897-f65d-4efa-912c-296a5a19af22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:44.823374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7b41d897-f65d-4efa-912c-296a5a19af22 None None] MFA Rules not processed for user `4e52a3464d8f4a3fa16a102336a4bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:07:44.824613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7b41d897-f65d-4efa-912c-296a5a19af22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:07:44.896552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 765/1518] 10.222.0.87 () {58 vars in 1015 bytes} [Wed Jul 20 22:07:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:07:48.978027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a8b4b-f468-4c41-ac4b-ce7866c42b44 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:48.978534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a8b4b-f468-4c41-ac4b-ce7866c42b44 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:48.978645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7a8b4b-f468-4c41-ac4b-ce7866c42b44 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:48.980610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 754/1519] 10.222.0.85 () {54 vars in 961 bytes} [Wed Jul 20 22:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:07:48.985548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b9f08-2bf6-4bcb-a764-54a0d45d4729 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:48.985978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b9f08-2bf6-4bcb-a764-54a0d45d4729 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:48.986088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b9f08-2bf6-4bcb-a764-54a0d45d4729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:49.004841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a45b9f08-2bf6-4bcb-a764-54a0d45d4729 None None] MFA Rules not processed for user `4e52a3464d8f4a3fa16a102336a4bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:07:49.006046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a45b9f08-2bf6-4bcb-a764-54a0d45d4729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:07:49.014697 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 766/1520] 10.222.0.85 () {58 vars in 1058 bytes} [Wed Jul 20 22:07:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:07:49.022008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a8b4b-f468-4c41-ac4b-ce7866c42b44 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:07:49.036203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7a8b4b-f468-4c41-ac4b-ce7866c42b44 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:07:49.041125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73857eb-ad17-4a48-ae5d-8e4ec158a8e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e52a3464d8f4a3fa16a102336a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:07:49.042360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73857eb-ad17-4a48-ae5d-8e4ec158a8e9 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:49.042644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73857eb-ad17-4a48-ae5d-8e4ec158a8e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:49.042921 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73857eb-ad17-4a48-ae5d-8e4ec158a8e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:49.051204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73857eb-ad17-4a48-ae5d-8e4ec158a8e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:07:49.052818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73857eb-ad17-4a48-ae5d-8e4ec158a8e9 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:07:49.062897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 755/1521] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:07:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:07:55.396416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d094b4-be94-4130-b53d-3c543f4abcdf None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:55.397014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d094b4-be94-4130-b53d-3c543f4abcdf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:55.397014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d094b4-be94-4130-b53d-3c543f4abcdf None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:55.398388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:07:55.403522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981c34f-3db3-4fe4-abdc-af7c9ec9b6a8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:55.403949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981c34f-3db3-4fe4-abdc-af7c9ec9b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:55.404111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981c34f-3db3-4fe4-abdc-af7c9ec9b6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:55.425209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9981c34f-3db3-4fe4-abdc-af7c9ec9b6a8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:07:55.426428 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9981c34f-3db3-4fe4-abdc-af7c9ec9b6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:07:55.435189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:07:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:07:55.590024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d094b4-be94-4130-b53d-3c543f4abcdf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:07:55.604479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d094b4-be94-4130-b53d-3c543f4abcdf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:07:55.610747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a4b74f-9961-48d2-bf20-88269edd75f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:07:55.611390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4b74f-9961-48d2-bf20-88269edd75f4 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:55.611673 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4b74f-9961-48d2-bf20-88269edd75f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:55.611981 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4b74f-9961-48d2-bf20-88269edd75f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:55.620478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4b74f-9961-48d2-bf20-88269edd75f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:07:55.622998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a4b74f-9961-48d2-bf20-88269edd75f4 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:07:55.632613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 768/1524] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:07:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:07:56.456686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b698-5cee-446a-9b8b-2014f11cfaa9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:56.457228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b698-5cee-446a-9b8b-2014f11cfaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:56.457228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590b698-5cee-446a-9b8b-2014f11cfaa9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:56.458647 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 20 22:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:07:56.463374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f642d71-5bb2-4e42-8f1b-0bb49eece0f8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:56.463806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f642d71-5bb2-4e42-8f1b-0bb49eece0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:56.463913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f642d71-5bb2-4e42-8f1b-0bb49eece0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:56.483688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4f642d71-5bb2-4e42-8f1b-0bb49eece0f8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:07:56.484917 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4f642d71-5bb2-4e42-8f1b-0bb49eece0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:07:56.492835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 20 22:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:07:56.644954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590b698-5cee-446a-9b8b-2014f11cfaa9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:07:56.660158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590b698-5cee-446a-9b8b-2014f11cfaa9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:07:56.665513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a2aa7-3e48-444e-8317-4272635a8fd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:07:56.666146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a2aa7-3e48-444e-8317-4272635a8fd7 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:07:56.666434 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a2aa7-3e48-444e-8317-4272635a8fd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:07:56.666707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a2aa7-3e48-444e-8317-4272635a8fd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:07:56.676183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a2aa7-3e48-444e-8317-4272635a8fd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:07:56.677783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a2aa7-3e48-444e-8317-4272635a8fd7 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:07:56.688206 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 758/1527] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:08:00.769149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ecdb8-30cb-4dd9-aee4-73f7f2d243ba None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:00.769771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ecdb8-30cb-4dd9-aee4-73f7f2d243ba None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:00.769771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14ecdb8-30cb-4dd9-aee4-73f7f2d243ba None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:00.771196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:08:00.776608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58751c-5d26-4d81-b513-c837cca3d34c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:00.777018 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58751c-5d26-4d81-b513-c837cca3d34c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:00.777165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d58751c-5d26-4d81-b513-c837cca3d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:00.917663 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3d58751c-5d26-4d81-b513-c837cca3d34c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:08:00.919376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3d58751c-5d26-4d81-b513-c837cca3d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:08:00.927267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:08:01.003383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ecdb8-30cb-4dd9-aee4-73f7f2d243ba None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:08:01.005097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e14ecdb8-30cb-4dd9-aee4-73f7f2d243ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:08:01.033285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:08:01.062492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14ecdb8-30cb-4dd9-aee4-73f7f2d243ba None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:08:01.066111 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0843b-e3e8-4f72-9781-2818a0361d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:08:01.066785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0843b-e3e8-4f72-9781-2818a0361d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:01.067065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0843b-e3e8-4f72-9781-2818a0361d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:01.067341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0843b-e3e8-4f72-9781-2818a0361d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:01.077488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0843b-e3e8-4f72-9781-2818a0361d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:08:01.078974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a0843b-e3e8-4f72-9781-2818a0361d54 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:08:01.088570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 771/1530] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:08:03.174059 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93eebc-edc5-4f2d-8b3c-7eaf6c683f8c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:03.174632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93eebc-edc5-4f2d-8b3c-7eaf6c683f8c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:03.174632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a93eebc-edc5-4f2d-8b3c-7eaf6c683f8c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:03.176051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:08:03.181260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbe564-3353-42a4-9bc9-b8c721ef6421 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:03.181706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbe564-3353-42a4-9bc9-b8c721ef6421 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:03.181817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbe564-3353-42a4-9bc9-b8c721ef6421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:03.200480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2abbe564-3353-42a4-9bc9-b8c721ef6421 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:08:03.201552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2abbe564-3353-42a4-9bc9-b8c721ef6421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:08:03.209340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:08:03.244661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93eebc-edc5-4f2d-8b3c-7eaf6c683f8c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:08:03.256301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a93eebc-edc5-4f2d-8b3c-7eaf6c683f8c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:08:03.259951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e3d0d-b422-4adb-8a35-4981ffc61152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:08:03.260586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e3d0d-b422-4adb-8a35-4981ffc61152 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:03.260891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e3d0d-b422-4adb-8a35-4981ffc61152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:03.261164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e3d0d-b422-4adb-8a35-4981ffc61152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:03.271241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e3d0d-b422-4adb-8a35-4981ffc61152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:08:03.272707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e3d0d-b422-4adb-8a35-4981ffc61152 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:08:03.282585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 761/1533] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:08:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:08:06.945732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9552-660b-44a5-a6ba-c9eaee2cd507 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:06.946310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9552-660b-44a5-a6ba-c9eaee2cd507 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:06.946310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf9552-660b-44a5-a6ba-c9eaee2cd507 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:06.947706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:08:06.953705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424e6a8-ed5e-4f68-a9bb-14ae0bb1159c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:06.954102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424e6a8-ed5e-4f68-a9bb-14ae0bb1159c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:06.954249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424e6a8-ed5e-4f68-a9bb-14ae0bb1159c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:06.972252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4424e6a8-ed5e-4f68-a9bb-14ae0bb1159c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:08:06.973439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4424e6a8-ed5e-4f68-a9bb-14ae0bb1159c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:08:06.981755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:08:07.284953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9552-660b-44a5-a6ba-c9eaee2cd507 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:08:07.286654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4ccf9552-660b-44a5-a6ba-c9eaee2cd507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:08:07.345741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf9552-660b-44a5-a6ba-c9eaee2cd507 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:08:07.349450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b711b07-3437-4bd5-ac8c-272fc6612eb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:08:07.350096 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b711b07-3437-4bd5-ac8c-272fc6612eb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:07.350380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b711b07-3437-4bd5-ac8c-272fc6612eb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:07.350659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b711b07-3437-4bd5-ac8c-272fc6612eb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:07.360569 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b711b07-3437-4bd5-ac8c-272fc6612eb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:08:07.362005 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b711b07-3437-4bd5-ac8c-272fc6612eb1 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:08:07.372012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 774/1536] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:08:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:08:09.457108 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428ca4-7037-4509-a4b2-bc6900f10d2f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:09.457499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428ca4-7037-4509-a4b2-bc6900f10d2f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:09.457661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9428ca4-7037-4509-a4b2-bc6900f10d2f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:09.459044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 20 22:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:08:09.464613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96223a-06a1-470e-b7a1-45a88c9ed97c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:09.465547 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96223a-06a1-470e-b7a1-45a88c9ed97c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:09.465876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96223a-06a1-470e-b7a1-45a88c9ed97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:09.484926 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bd96223a-06a1-470e-b7a1-45a88c9ed97c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:08:09.486114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bd96223a-06a1-470e-b7a1-45a88c9ed97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:08:09.493882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 20 22:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:08:09.801066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9428ca4-7037-4509-a4b2-bc6900f10d2f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:08:09.802747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f9428ca4-7037-4509-a4b2-bc6900f10d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:08:09.816329 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9428ca4-7037-4509-a4b2-bc6900f10d2f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:08:09.820538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784d6b5-cc8b-482e-88f5-17e782ab5756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:08:09.821216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784d6b5-cc8b-482e-88f5-17e782ab5756 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:08:09.821541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784d6b5-cc8b-482e-88f5-17e782ab5756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:08:09.821892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784d6b5-cc8b-482e-88f5-17e782ab5756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:08:09.832193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784d6b5-cc8b-482e-88f5-17e782ab5756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:08:09.833625 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784d6b5-cc8b-482e-88f5-17e782ab5756 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:08:09.843772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 764/1539] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:08:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:08:19.479374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=47 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:08:19.838857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=82 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:42.540987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167bcd2-e34c-4b44-b51a-574beb5b8e92 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:42.557043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167bcd2-e34c-4b44-b51a-574beb5b8e92 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:42.557043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167bcd2-e34c-4b44-b51a-574beb5b8e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:42.569011 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c167bcd2-e34c-4b44-b51a-574beb5b8e92 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:42.570366 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c167bcd2-e34c-4b44-b51a-574beb5b8e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:42.578950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 776/1540] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:42.588139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffe144-ff1b-4b09-bc46-2fb1a0dcb6f2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:42.591058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffe144-ff1b-4b09-bc46-2fb1a0dcb6f2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:42.591058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbffe144-ff1b-4b09-bc46-2fb1a0dcb6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:42.613848 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bbffe144-ff1b-4b09-bc46-2fb1a0dcb6f2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:42.615544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bbffe144-ff1b-4b09-bc46-2fb1a0dcb6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:42.627108 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 765/1541] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:42.631448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167bcd2-e34c-4b44-b51a-574beb5b8e92 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:42.647009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167bcd2-e34c-4b44-b51a-574beb5b8e92 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:42.658983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613563ef-74b2-434a-98bc-52246021b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:42.659666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613563ef-74b2-434a-98bc-52246021b3ab admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:42.659985 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613563ef-74b2-434a-98bc-52246021b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:42.660522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613563ef-74b2-434a-98bc-52246021b3ab admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:42.661289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613563ef-74b2-434a-98bc-52246021b3ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:09:42.661597 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613563ef-74b2-434a-98bc-52246021b3ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:42.663209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613563ef-74b2-434a-98bc-52246021b3ab admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:42.690382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 777/1542] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:09:42.698445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffe144-ff1b-4b09-bc46-2fb1a0dcb6f2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:42.711955 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbffe144-ff1b-4b09-bc46-2fb1a0dcb6f2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:42.720338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3153dbc-7df4-4313-9b20-b17d49382856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:42.721296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3153dbc-7df4-4313-9b20-b17d49382856 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:42.721791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3153dbc-7df4-4313-9b20-b17d49382856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:42.722271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3153dbc-7df4-4313-9b20-b17d49382856 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:42.723177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3153dbc-7df4-4313-9b20-b17d49382856 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:42.725330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3153dbc-7df4-4313-9b20-b17d49382856 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:42.839010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 766/1543] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:42 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:42.851598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613563ef-74b2-434a-98bc-52246021b3ab admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:42.866708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613563ef-74b2-434a-98bc-52246021b3ab admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:42.940995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c3799-b45c-400c-ae17-42b26974d3e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:42.942059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c3799-b45c-400c-ae17-42b26974d3e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:42.948504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c3799-b45c-400c-ae17-42b26974d3e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:42.948987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8c3799-b45c-400c-ae17-42b26974d3e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:42.950036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c3799-b45c-400c-ae17-42b26974d3e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:42.964750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8c3799-b45c-400c-ae17-42b26974d3e7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:43.046194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 778/1544] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:42 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:43.050477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3153dbc-7df4-4313-9b20-b17d49382856 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:43.062126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3153dbc-7df4-4313-9b20-b17d49382856 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:43.075771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c107495-b1f1-4c0a-bf17-f492ec3ddca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:43.076951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c107495-b1f1-4c0a-bf17-f492ec3ddca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.077515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c107495-b1f1-4c0a-bf17-f492ec3ddca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.078919 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c107495-b1f1-4c0a-bf17-f492ec3ddca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.080011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c107495-b1f1-4c0a-bf17-f492ec3ddca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:43.081852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c107495-b1f1-4c0a-bf17-f492ec3ddca3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:43.097519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 767/1545] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:43.102207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c3799-b45c-400c-ae17-42b26974d3e7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:43.123091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8c3799-b45c-400c-ae17-42b26974d3e7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:43.135033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6acd9-081b-421d-9268-6853dfc03cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:43.135745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6acd9-081b-421d-9268-6853dfc03cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.136058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6acd9-081b-421d-9268-6853dfc03cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.136340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6acd9-081b-421d-9268-6853dfc03cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.137101 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6acd9-081b-421d-9268-6853dfc03cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:43.138795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6acd9-081b-421d-9268-6853dfc03cdb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:43.156333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 779/1546] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:43.161640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c107495-b1f1-4c0a-bf17-f492ec3ddca3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:43.179397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c107495-b1f1-4c0a-bf17-f492ec3ddca3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:43.207362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c446d8-6a1d-4bca-b6b2-94aa9228041a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:43.209630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e802e-3f75-46ef-b334-c40605efa648 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.209925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e802e-3f75-46ef-b334-c40605efa648 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.210217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193e802e-3f75-46ef-b334-c40605efa648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.212988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c446d8-6a1d-4bca-b6b2-94aa9228041a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.220867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c446d8-6a1d-4bca-b6b2-94aa9228041a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.220867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c446d8-6a1d-4bca-b6b2-94aa9228041a admin admin] PATH_INFO: `/v3/projects/3da5a259638149a392b24104efa2ecd4/users/083a9b6e9e0e4091957c13ce23809b95/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.232899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c446d8-6a1d-4bca-b6b2-94aa9228041a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3da5a259638149a392b24104efa2ecd4, user_id=083a9b6e9e0e4091957c13ce23809b95, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:43.239231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c446d8-6a1d-4bca-b6b2-94aa9228041a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:43.255994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-193e802e-3f75-46ef-b334-c40605efa648 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:43.257721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-193e802e-3f75-46ef-b334-c40605efa648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:43.279200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 780/1547] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:09:43.289237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db072d4-0a66-49fa-949f-793c7af6457e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.289530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db072d4-0a66-49fa-949f-793c7af6457e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.289810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db072d4-0a66-49fa-949f-793c7af6457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.321686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 768/1548] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:43 2022] PUT /identity/v3/projects/3da5a259638149a392b24104efa2ecd4/users/083a9b6e9e0e4091957c13ce23809b95/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:43.330582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5db072d4-0a66-49fa-949f-793c7af6457e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:43.331871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5db072d4-0a66-49fa-949f-793c7af6457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:43.338493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb74fb-b654-4e14-9e43-5ae72c0938d2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.339125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb74fb-b654-4e14-9e43-5ae72c0938d2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.339477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb74fb-b654-4e14-9e43-5ae72c0938d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.383474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d1eb74fb-b654-4e14-9e43-5ae72c0938d2 None None] MFA Rules not processed for user `083a9b6e9e0e4091957c13ce23809b95`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:43.384627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d1eb74fb-b654-4e14-9e43-5ae72c0938d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:43.455383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 781/1549] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:43.474879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4bc8-3de2-41d9-b224-ebbfa53b54c0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.475234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4bc8-3de2-41d9-b224-ebbfa53b54c0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.475510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff4bc8-3de2-41d9-b224-ebbfa53b54c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.542701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-efff4bc8-3de2-41d9-b224-ebbfa53b54c0 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:43.550568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-efff4bc8-3de2-41d9-b224-ebbfa53b54c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:43.571664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 782/1550] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:43.572704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4bc8-3de2-41d9-b224-ebbfa53b54c0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:43.574092 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 769/1551] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:09:43.589387 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee2a17-2686-4673-a99c-b8b25af0b857 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.596545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee2a17-2686-4673-a99c-b8b25af0b857 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.596545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee2a17-2686-4673-a99c-b8b25af0b857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.604730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff4bc8-3de2-41d9-b224-ebbfa53b54c0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:43.630297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2932e1e-aabe-442d-8abf-cb34c70e6bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:43.630297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932e1e-aabe-442d-8abf-cb34c70e6bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.630297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932e1e-aabe-442d-8abf-cb34c70e6bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.630297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2932e1e-aabe-442d-8abf-cb34c70e6bd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.630776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932e1e-aabe-442d-8abf-cb34c70e6bd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:09:43.630776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932e1e-aabe-442d-8abf-cb34c70e6bd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:43.633191 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2932e1e-aabe-442d-8abf-cb34c70e6bd6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:43.642786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9aee2a17-2686-4673-a99c-b8b25af0b857 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:43.644457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9aee2a17-2686-4673-a99c-b8b25af0b857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:43.674585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 770/1552] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:43.675824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 783/1553] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:09:43.676521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0153020-1f80-4405-971a-748e56b3cae9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.677034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0153020-1f80-4405-971a-748e56b3cae9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.677297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8f664-1a5b-46a6-bccf-bd360f2e15e2 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.677589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8f664-1a5b-46a6-bccf-bd360f2e15e2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.677872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8f664-1a5b-46a6-bccf-bd360f2e15e2 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.678119 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0153020-1f80-4405-971a-748e56b3cae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.679165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 784/1554] 10.222.0.85 () {54 vars in 962 bytes} [Wed Jul 20 22:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:09:43.686088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8f664-1a5b-46a6-bccf-bd360f2e15e2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:43.710445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c0153020-1f80-4405-971a-748e56b3cae9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:43.712094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c0153020-1f80-4405-971a-748e56b3cae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:43.718233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8f664-1a5b-46a6-bccf-bd360f2e15e2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:43.722368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 771/1555] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:43.724039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a53ec8-7d70-4be6-8f05-6473cf34b03e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.724876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a53ec8-7d70-4be6-8f05-6473cf34b03e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.725363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a53ec8-7d70-4be6-8f05-6473cf34b03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.742325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e9657-1527-4d46-afe7-89dfb6f2724d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:43.743002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e9657-1527-4d46-afe7-89dfb6f2724d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.743290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e9657-1527-4d46-afe7-89dfb6f2724d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.743564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664e9657-1527-4d46-afe7-89dfb6f2724d admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.744329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e9657-1527-4d46-afe7-89dfb6f2724d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:09:43.744636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e9657-1527-4d46-afe7-89dfb6f2724d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:43.746409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664e9657-1527-4d46-afe7-89dfb6f2724d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:43.768893 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-16a53ec8-7d70-4be6-8f05-6473cf34b03e None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:43.770467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-16a53ec8-7d70-4be6-8f05-6473cf34b03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:43.775700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 785/1556] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:09:43.776575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e9657-1527-4d46-afe7-89dfb6f2724d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:43.801532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664e9657-1527-4d46-afe7-89dfb6f2724d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:43.811209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d59d9-195e-4274-b62b-f7813833b999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:43.811879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d59d9-195e-4274-b62b-f7813833b999 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.812186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d59d9-195e-4274-b62b-f7813833b999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.813159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d59d9-195e-4274-b62b-f7813833b999 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.813870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d59d9-195e-4274-b62b-f7813833b999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:43.814877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-732d59d9-195e-4274-b62b-f7813833b999 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:09:43.814877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: warnings.warn(msg) Jul 20 22:09:43.814877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: Jul 20 22:09:43.816123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d59d9-195e-4274-b62b-f7813833b999 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:43.842607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:43.860344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 772/1557] 10.222.0.85 () {58 vars in 1059 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:43.861791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30612e1-07da-4e7b-9c08-cda1cadb5425 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.862118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30612e1-07da-4e7b-9c08-cda1cadb5425 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.862358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30612e1-07da-4e7b-9c08-cda1cadb5425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.881951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a30612e1-07da-4e7b-9c08-cda1cadb5425 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:43.883155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a30612e1-07da-4e7b-9c08-cda1cadb5425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:43.887664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:43.895489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 773/1558] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:43.895489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788cd33-06a5-478c-b9ff-6b5f4040a9d1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.895489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788cd33-06a5-478c-b9ff-6b5f4040a9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.895489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788cd33-06a5-478c-b9ff-6b5f4040a9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.899207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 786/1559] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:43.900116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d59d9-195e-4274-b62b-f7813833b999 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:43.918642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a788cd33-06a5-478c-b9ff-6b5f4040a9d1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:43.919950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a788cd33-06a5-478c-b9ff-6b5f4040a9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:43.964774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d59d9-195e-4274-b62b-f7813833b999 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:43.970198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8fc0b5-bb17-42d4-a2ce-61cf25010f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:43.971153 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc0b5-bb17-42d4-a2ce-61cf25010f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.971153 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc0b5-bb17-42d4-a2ce-61cf25010f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.971382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8fc0b5-bb17-42d4-a2ce-61cf25010f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:43.972109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fc0b5-bb17-42d4-a2ce-61cf25010f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:43.973993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8fc0b5-bb17-42d4-a2ce-61cf25010f78 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:43.980817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 774/1560] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:43.985649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab4eef-1033-4a8d-a408-58a4d457c564 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:43.985968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab4eef-1033-4a8d-a408-58a4d457c564 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:43.986376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab4eef-1033-4a8d-a408-58a4d457c564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.004249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-97ab4eef-1033-4a8d-a408-58a4d457c564 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:44.005914 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-97ab4eef-1033-4a8d-a408-58a4d457c564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:44.013866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 775/1561] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:44.015064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b38ea-08a1-4ac5-8ab7-e05f63187816 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.015354 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b38ea-08a1-4ac5-8ab7-e05f63187816 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.016196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928b38ea-08a1-4ac5-8ab7-e05f63187816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.034809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-928b38ea-08a1-4ac5-8ab7-e05f63187816 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:44.036291 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-928b38ea-08a1-4ac5-8ab7-e05f63187816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:44.044148 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 776/1562] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:44.044903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b38ea-08a1-4ac5-8ab7-e05f63187816 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.083954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 787/1563] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:43 2022] POST /identity/v3/projects => generated 405 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:44.085278 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c85bf-390f-49d1-8e16-0396407b4417 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.085566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c85bf-390f-49d1-8e16-0396407b4417 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.085843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c85bf-390f-49d1-8e16-0396407b4417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.105513 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-612c85bf-390f-49d1-8e16-0396407b4417 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:44.106757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-612c85bf-390f-49d1-8e16-0396407b4417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:44.116093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928b38ea-08a1-4ac5-8ab7-e05f63187816 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.167513 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 788/1564] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:44.168758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893addd4-fe64-4e5b-81ad-d88fc55d6081 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.169047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893addd4-fe64-4e5b-81ad-d88fc55d6081 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.169328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893addd4-fe64-4e5b-81ad-d88fc55d6081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.180164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce30b9-2972-49d1-ac45-b9a2a21a93db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.180820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce30b9-2972-49d1-ac45-b9a2a21a93db service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.181102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce30b9-2972-49d1-ac45-b9a2a21a93db service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.181375 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce30b9-2972-49d1-ac45-b9a2a21a93db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.186766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:44.187210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-893addd4-fe64-4e5b-81ad-d88fc55d6081 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:44.188559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-893addd4-fe64-4e5b-81ad-d88fc55d6081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:44.196437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 789/1565] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:44.200335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893addd4-fe64-4e5b-81ad-d88fc55d6081 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.207024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893addd4-fe64-4e5b-81ad-d88fc55d6081 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.211628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb88f0-cb1e-45d4-9266-63ab5008ad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.212312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb88f0-cb1e-45d4-9266-63ab5008ad16 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.212594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb88f0-cb1e-45d4-9266-63ab5008ad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.212870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb88f0-cb1e-45d4-9266-63ab5008ad16 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.213556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb88f0-cb1e-45d4-9266-63ab5008ad16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.215475 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb88f0-cb1e-45d4-9266-63ab5008ad16 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.238406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce30b9-2972-49d1-ac45-b9a2a21a93db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.240060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce30b9-2972-49d1-ac45-b9a2a21a93db service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.248971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 777/1566] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:44.249763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce30b9-2972-49d1-ac45-b9a2a21a93db service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.260365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce30b9-2972-49d1-ac45-b9a2a21a93db service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.265406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a483f8a8-0544-4a21-ac72-7b761ae5ab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.266716 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483f8a8-0544-4a21-ac72-7b761ae5ab1f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.267088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483f8a8-0544-4a21-ac72-7b761ae5ab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.267365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a483f8a8-0544-4a21-ac72-7b761ae5ab1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.268156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483f8a8-0544-4a21-ac72-7b761ae5ab1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:09:44.268491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483f8a8-0544-4a21-ac72-7b761ae5ab1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.269508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-a483f8a8-0544-4a21-ac72-7b761ae5ab1f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:09:44.269508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: warnings.warn(msg) Jul 20 22:09:44.269508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: Jul 20 22:09:44.270384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a483f8a8-0544-4a21-ac72-7b761ae5ab1f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.282779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 778/1567] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:09:44.283853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146779-26be-4764-9563-990e0d2152b1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.284175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146779-26be-4764-9563-990e0d2152b1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.284456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146779-26be-4764-9563-990e0d2152b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.295735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 790/1568] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:44.299913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773c34f-0d2d-4734-aa17-f2439cde602a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.299913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773c34f-0d2d-4734-aa17-f2439cde602a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.299913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773c34f-0d2d-4734-aa17-f2439cde602a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.302934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7c146779-26be-4764-9563-990e0d2152b1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:44.304552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7c146779-26be-4764-9563-990e0d2152b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:44.313829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 779/1569] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:44.314095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c146779-26be-4764-9563-990e0d2152b1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.322436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6773c34f-0d2d-4734-aa17-f2439cde602a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:44.323861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c146779-26be-4764-9563-990e0d2152b1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.324113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6773c34f-0d2d-4734-aa17-f2439cde602a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:44.329159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16c8a8-eb0e-4d63-ab64-25a0f1b06bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.329758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16c8a8-eb0e-4d63-ab64-25a0f1b06bc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.330037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16c8a8-eb0e-4d63-ab64-25a0f1b06bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.330310 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16c8a8-eb0e-4d63-ab64-25a0f1b06bc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.331012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16c8a8-eb0e-4d63-ab64-25a0f1b06bc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.332193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-ec16c8a8-eb0e-4d63-ab64-25a0f1b06bc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:09:44.332193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: warnings.warn(msg) Jul 20 22:09:44.332193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: Jul 20 22:09:44.333390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16c8a8-eb0e-4d63-ab64-25a0f1b06bc3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.337968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 791/1570] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:44.337968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d260-7a4f-4f5a-91a1-b3e0621c41b6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.337968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d260-7a4f-4f5a-91a1-b3e0621c41b6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.337968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023d260-7a4f-4f5a-91a1-b3e0621c41b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.356835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1023d260-7a4f-4f5a-91a1-b3e0621c41b6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:44.362944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1023d260-7a4f-4f5a-91a1-b3e0621c41b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:44.366620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 792/1571] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:44.367395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023d260-7a4f-4f5a-91a1-b3e0621c41b6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.377649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023d260-7a4f-4f5a-91a1-b3e0621c41b6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.382304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d21d4-23b3-45dc-990c-4797269b6d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.382956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d21d4-23b3-45dc-990c-4797269b6d75 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.383253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d21d4-23b3-45dc-990c-4797269b6d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.386111 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31d21d4-23b3-45dc-990c-4797269b6d75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.386111 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d21d4-23b3-45dc-990c-4797269b6d75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:09:44.386111 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d21d4-23b3-45dc-990c-4797269b6d75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.386375 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31d21d4-23b3-45dc-990c-4797269b6d75 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.400068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 793/1572] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:09:44.400904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d21d4-23b3-45dc-990c-4797269b6d75 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.410653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 780/1573] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:44.411682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16c8a8-eb0e-4d63-ab64-25a0f1b06bc3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.419741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31d21d4-23b3-45dc-990c-4797269b6d75 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.422322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16c8a8-eb0e-4d63-ab64-25a0f1b06bc3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.425009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca8210-75ae-4d7d-aa74-9182bbeec01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.425667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca8210-75ae-4d7d-aa74-9182bbeec01c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.425954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca8210-75ae-4d7d-aa74-9182bbeec01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.426232 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ca8210-75ae-4d7d-aa74-9182bbeec01c admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.426924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca8210-75ae-4d7d-aa74-9182bbeec01c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.428244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ad5a4-c661-4989-9c70-08a8e55d3ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.428890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ca8210-75ae-4d7d-aa74-9182bbeec01c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.429245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad5a4-c661-4989-9c70-08a8e55d3ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.429678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad5a4-c661-4989-9c70-08a8e55d3ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.430248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6ad5a4-c661-4989-9c70-08a8e55d3ea4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.431747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ad5a4-c661-4989-9c70-08a8e55d3ea4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.433630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6ad5a4-c661-4989-9c70-08a8e55d3ea4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.446292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 781/1574] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:44.447376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ad5a4-c661-4989-9c70-08a8e55d3ea4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.460182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6ad5a4-c661-4989-9c70-08a8e55d3ea4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.464728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64634a5-d796-4730-9339-66b8f0a8acf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.465367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64634a5-d796-4730-9339-66b8f0a8acf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.465650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64634a5-d796-4730-9339-66b8f0a8acf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.465927 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64634a5-d796-4730-9339-66b8f0a8acf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.466643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64634a5-d796-4730-9339-66b8f0a8acf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:09:44.466950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64634a5-d796-4730-9339-66b8f0a8acf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.468563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64634a5-d796-4730-9339-66b8f0a8acf1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.488553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 782/1575] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:09:44.488553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64634a5-d796-4730-9339-66b8f0a8acf1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.495373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 794/1576] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:44.496021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64634a5-d796-4730-9339-66b8f0a8acf1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.496704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca8210-75ae-4d7d-aa74-9182bbeec01c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.511229 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:44.558620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba9145-8bc8-48b7-9d61-aa714cbf693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.559316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba9145-8bc8-48b7-9d61-aa714cbf693e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.559605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba9145-8bc8-48b7-9d61-aa714cbf693e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.559887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba9145-8bc8-48b7-9d61-aa714cbf693e admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.560891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba9145-8bc8-48b7-9d61-aa714cbf693e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:09:44.561203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba9145-8bc8-48b7-9d61-aa714cbf693e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.563550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba9145-8bc8-48b7-9d61-aa714cbf693e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.564483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ca8210-75ae-4d7d-aa74-9182bbeec01c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.569753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a65c-75f0-47d4-ae8d-df97f071fa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.570428 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a65c-75f0-47d4-ae8d-df97f071fa0e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.570696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a65c-75f0-47d4-ae8d-df97f071fa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.570969 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f2a65c-75f0-47d4-ae8d-df97f071fa0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.571757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2a65c-75f0-47d4-ae8d-df97f071fa0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:09:44.572029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2a65c-75f0-47d4-ae8d-df97f071fa0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.577571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f2a65c-75f0-47d4-ae8d-df97f071fa0e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.577683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 783/1577] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:09:44.577683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba9145-8bc8-48b7-9d61-aa714cbf693e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.586714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba9145-8bc8-48b7-9d61-aa714cbf693e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.590633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 795/1578] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:09:44.591471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e31691f-93de-46a2-a411-e441ab07e4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.591975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a65c-75f0-47d4-ae8d-df97f071fa0e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.592232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31691f-93de-46a2-a411-e441ab07e4ac admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.592436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31691f-93de-46a2-a411-e441ab07e4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.592686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e31691f-93de-46a2-a411-e441ab07e4ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.593365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31691f-93de-46a2-a411-e441ab07e4ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.595802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e31691f-93de-46a2-a411-e441ab07e4ac admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.607094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f2a65c-75f0-47d4-ae8d-df97f071fa0e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.612677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c06e2-8448-44b7-835d-5c903483de5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.613335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c06e2-8448-44b7-835d-5c903483de5a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.613618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c06e2-8448-44b7-835d-5c903483de5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.613897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3c06e2-8448-44b7-835d-5c903483de5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.614627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c06e2-8448-44b7-835d-5c903483de5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.616274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3c06e2-8448-44b7-835d-5c903483de5a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.627872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 796/1579] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:44.628889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c06e2-8448-44b7-835d-5c903483de5a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.638591 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3c06e2-8448-44b7-835d-5c903483de5a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.644482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170ac07-ee57-4b28-aa9f-992916db1e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.645098 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170ac07-ee57-4b28-aa9f-992916db1e5c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.645372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170ac07-ee57-4b28-aa9f-992916db1e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.645703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170ac07-ee57-4b28-aa9f-992916db1e5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.646531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170ac07-ee57-4b28-aa9f-992916db1e5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.648130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170ac07-ee57-4b28-aa9f-992916db1e5c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.658857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 797/1580] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:44.659774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170ac07-ee57-4b28-aa9f-992916db1e5c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.669954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170ac07-ee57-4b28-aa9f-992916db1e5c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.674734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7c87d-938f-4dff-8288-2111ae01d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.675353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7c87d-938f-4dff-8288-2111ae01d19d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.675631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7c87d-938f-4dff-8288-2111ae01d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.675899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7c87d-938f-4dff-8288-2111ae01d19d admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.677022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7c87d-938f-4dff-8288-2111ae01d19d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.678536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7c87d-938f-4dff-8288-2111ae01d19d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.712292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 784/1581] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/projects => generated 391 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:44.715645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b2f51-072b-4e42-8b0d-369c8fae18ee None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.715645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b2f51-072b-4e42-8b0d-369c8fae18ee None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.715645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b2f51-072b-4e42-8b0d-369c8fae18ee None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.715645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 785/1582] 10.222.0.85 () {54 vars in 912 bytes} [Wed Jul 20 22:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:09:44.716507 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b2f51-072b-4e42-8b0d-369c8fae18ee None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.736615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:44.769524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 798/1583] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:44.770341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7c87d-938f-4dff-8288-2111ae01d19d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.783088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b2f51-072b-4e42-8b0d-369c8fae18ee None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.834852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7c87d-938f-4dff-8288-2111ae01d19d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.839634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fa5f8-eb60-4f14-8606-cdc8f5d16075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.840337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fa5f8-eb60-4f14-8606-cdc8f5d16075 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.840620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fa5f8-eb60-4f14-8606-cdc8f5d16075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.840912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e041a45-1f06-4fea-a0f2-8241973f227d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.841087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2fa5f8-eb60-4f14-8606-cdc8f5d16075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.841767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fa5f8-eb60-4f14-8606-cdc8f5d16075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.842120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041a45-1f06-4fea-a0f2-8241973f227d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.842405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041a45-1f06-4fea-a0f2-8241973f227d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.842681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041a45-1f06-4fea-a0f2-8241973f227d admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.843365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e041a45-1f06-4fea-a0f2-8241973f227d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.844340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2fa5f8-eb60-4f14-8606-cdc8f5d16075 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.846345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e041a45-1f06-4fea-a0f2-8241973f227d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.932832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 786/1584] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:44.933573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e041a45-1f06-4fea-a0f2-8241973f227d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:44.943334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e041a45-1f06-4fea-a0f2-8241973f227d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:44.947949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58493546-3281-476e-9886-d0916c70660b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:44.948635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58493546-3281-476e-9886-d0916c70660b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:44.948924 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58493546-3281-476e-9886-d0916c70660b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:44.949207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58493546-3281-476e-9886-d0916c70660b admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:44.949889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58493546-3281-476e-9886-d0916c70660b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:44.951802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58493546-3281-476e-9886-d0916c70660b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:44.958106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 799/1585] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:44.962488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fa5f8-eb60-4f14-8606-cdc8f5d16075 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.012511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:45.027158 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2fa5f8-eb60-4f14-8606-cdc8f5d16075 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.032038 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aeb10-11ec-4ee4-8b40-f0ae8484e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.036025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 787/1586] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:44 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:45.036192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aeb10-11ec-4ee4-8b40-f0ae8484e1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.036192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aeb10-11ec-4ee4-8b40-f0ae8484e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.036192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aeb10-11ec-4ee4-8b40-f0ae8484e1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.036484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58493546-3281-476e-9886-d0916c70660b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.036583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28aeb10-11ec-4ee4-8b40-f0ae8484e1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.036583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28aeb10-11ec-4ee4-8b40-f0ae8484e1d5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.046443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 800/1587] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:45.047677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aeb10-11ec-4ee4-8b40-f0ae8484e1d5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.059538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aeb10-11ec-4ee4-8b40-f0ae8484e1d5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.101221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58493546-3281-476e-9886-d0916c70660b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.106069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f86fb-8a93-4f78-bded-310128bfff05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.106960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f86fb-8a93-4f78-bded-310128bfff05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.107229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f86fb-8a93-4f78-bded-310128bfff05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.107498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8f86fb-8a93-4f78-bded-310128bfff05 admin admin] PATH_INFO: `/v3/projects/c19ac26c5a284c4c84f3f9f3003a7e7c/users/8cbac3c664d944788b05516600b7df25/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.119130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1571a72-962d-4154-9e22-34c1a4f97a28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.119795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1571a72-962d-4154-9e22-34c1a4f97a28 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.120103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1571a72-962d-4154-9e22-34c1a4f97a28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.120377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1571a72-962d-4154-9e22-34c1a4f97a28 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.121062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1571a72-962d-4154-9e22-34c1a4f97a28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.122543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f86fb-8a93-4f78-bded-310128bfff05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c19ac26c5a284c4c84f3f9f3003a7e7c, user_id=8cbac3c664d944788b05516600b7df25, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.123012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1571a72-962d-4154-9e22-34c1a4f97a28 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.126192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8f86fb-8a93-4f78-bded-310128bfff05 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.191141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 801/1588] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:45 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:45.191801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 788/1589] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:45 2022] PUT /identity/v3/projects/c19ac26c5a284c4c84f3f9f3003a7e7c/users/8cbac3c664d944788b05516600b7df25/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:45.192436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0694b-d358-4a3e-aee4-a71b2e6621ec None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.192573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f86fb-8a93-4f78-bded-310128bfff05 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.192725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0694b-d358-4a3e-aee4-a71b2e6621ec None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.192997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc0694b-d358-4a3e-aee4-a71b2e6621ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.214926 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bfc0694b-d358-4a3e-aee4-a71b2e6621ec None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:45.215461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:45.216160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bfc0694b-d358-4a3e-aee4-a71b2e6621ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:45.258994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8f86fb-8a93-4f78-bded-310128bfff05 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.263971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d1f88-1630-41de-bda6-c8b306302bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.264646 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d1f88-1630-41de-bda6-c8b306302bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.264928 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d1f88-1630-41de-bda6-c8b306302bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.265205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d1f88-1630-41de-bda6-c8b306302bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.266661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d1f88-1630-41de-bda6-c8b306302bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.268823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277d1f88-1630-41de-bda6-c8b306302bf6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.286570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 802/1590] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:09:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:45.287507 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0694b-d358-4a3e-aee4-a71b2e6621ec None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.298685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc0694b-d358-4a3e-aee4-a71b2e6621ec None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.305589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050604bf-0468-4f9a-b390-067fa44f4922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.305589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050604bf-0468-4f9a-b390-067fa44f4922 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.305589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050604bf-0468-4f9a-b390-067fa44f4922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.305589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050604bf-0468-4f9a-b390-067fa44f4922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.305981 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050604bf-0468-4f9a-b390-067fa44f4922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.306744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050604bf-0468-4f9a-b390-067fa44f4922 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.317430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 803/1591] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:45.318335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050604bf-0468-4f9a-b390-067fa44f4922 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.328848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050604bf-0468-4f9a-b390-067fa44f4922 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.333474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e8dd-91ee-4d44-a427-98ae96786cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.334088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e8dd-91ee-4d44-a427-98ae96786cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.339993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e8dd-91ee-4d44-a427-98ae96786cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.339993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d4e8dd-91ee-4d44-a427-98ae96786cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.339993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4e8dd-91ee-4d44-a427-98ae96786cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.339993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d4e8dd-91ee-4d44-a427-98ae96786cb5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.396707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 789/1592] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:45 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:45.397768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d1f88-1630-41de-bda6-c8b306302bf6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.407499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d1f88-1630-41de-bda6-c8b306302bf6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.412358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c186a7-3e41-4713-ae85-98ef5cfd3818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.412996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c186a7-3e41-4713-ae85-98ef5cfd3818 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.413282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c186a7-3e41-4713-ae85-98ef5cfd3818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.413558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c186a7-3e41-4713-ae85-98ef5cfd3818 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.414235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c186a7-3e41-4713-ae85-98ef5cfd3818 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.416178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c186a7-3e41-4713-ae85-98ef5cfd3818 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.430937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 804/1593] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:45 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:45.431898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e8dd-91ee-4d44-a427-98ae96786cb5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.443187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d4e8dd-91ee-4d44-a427-98ae96786cb5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.447768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cc0fc-e710-47b5-a4ab-dd2f05d62399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.448668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cc0fc-e710-47b5-a4ab-dd2f05d62399 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.448954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cc0fc-e710-47b5-a4ab-dd2f05d62399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.449242 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709cc0fc-e710-47b5-a4ab-dd2f05d62399 admin admin] PATH_INFO: `/v3/projects/bedc671041b24539b337fc0485b9eca4/users/f602a2bdf3e1437faacfeeccb1b75d83/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.464690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cc0fc-e710-47b5-a4ab-dd2f05d62399 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bedc671041b24539b337fc0485b9eca4, user_id=f602a2bdf3e1437faacfeeccb1b75d83, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.465762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-709cc0fc-e710-47b5-a4ab-dd2f05d62399 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:09:45.465762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: warnings.warn(msg) Jul 20 22:09:45.465762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: Jul 20 22:09:45.467706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709cc0fc-e710-47b5-a4ab-dd2f05d62399 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.504619 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 790/1594] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:45 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:45.505467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c186a7-3e41-4713-ae85-98ef5cfd3818 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.516657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c186a7-3e41-4713-ae85-98ef5cfd3818 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.521589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69eb0e2-f1b1-4870-92c4-3b6fc7bf6ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.522248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eb0e2-f1b1-4870-92c4-3b6fc7bf6ae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.522527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eb0e2-f1b1-4870-92c4-3b6fc7bf6ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.522797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69eb0e2-f1b1-4870-92c4-3b6fc7bf6ae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.523518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69eb0e2-f1b1-4870-92c4-3b6fc7bf6ae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.525156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69eb0e2-f1b1-4870-92c4-3b6fc7bf6ae7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.536145 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 791/1595] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:45.537416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3525ac-81b1-4346-a064-fbfb91fdb47a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.537704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3525ac-81b1-4346-a064-fbfb91fdb47a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.537979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3525ac-81b1-4346-a064-fbfb91fdb47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.557538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7b3525ac-81b1-4346-a064-fbfb91fdb47a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:45.558777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7b3525ac-81b1-4346-a064-fbfb91fdb47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:45.564009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 805/1596] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:45 2022] PUT /identity/v3/projects/bedc671041b24539b337fc0485b9eca4/users/f602a2bdf3e1437faacfeeccb1b75d83/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:45.564219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cc0fc-e710-47b5-a4ab-dd2f05d62399 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.577947 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:45.621881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709cc0fc-e710-47b5-a4ab-dd2f05d62399 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.622186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 792/1597] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:45.623263 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3525ac-81b1-4346-a064-fbfb91fdb47a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.633944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87506dd1-13c4-4020-bd68-5f421d8bf458 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.633944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87506dd1-13c4-4020-bd68-5f421d8bf458 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.633944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87506dd1-13c4-4020-bd68-5f421d8bf458 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.633944 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87506dd1-13c4-4020-bd68-5f421d8bf458 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.634376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3525ac-81b1-4346-a064-fbfb91fdb47a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.638650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d0f68-ae9a-4ed6-9c2d-7061eb413bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.639067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d0f68-ae9a-4ed6-9c2d-7061eb413bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.639352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d0f68-ae9a-4ed6-9c2d-7061eb413bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.639616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97d0f68-ae9a-4ed6-9c2d-7061eb413bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.640509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d0f68-ae9a-4ed6-9c2d-7061eb413bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.642103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97d0f68-ae9a-4ed6-9c2d-7061eb413bb8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.652187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 793/1598] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:45.653049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d0f68-ae9a-4ed6-9c2d-7061eb413bb8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.664771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97d0f68-ae9a-4ed6-9c2d-7061eb413bb8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.669343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096b566-c056-4846-87a3-a93b6f1ad759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.669989 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b566-c056-4846-87a3-a93b6f1ad759 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.670268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b566-c056-4846-87a3-a93b6f1ad759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.670538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096b566-c056-4846-87a3-a93b6f1ad759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.671251 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096b566-c056-4846-87a3-a93b6f1ad759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.673595 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096b566-c056-4846-87a3-a93b6f1ad759 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.683509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 794/1599] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:45.684353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096b566-c056-4846-87a3-a93b6f1ad759 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.694509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096b566-c056-4846-87a3-a93b6f1ad759 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.698924 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849915b-4965-4bab-b9d3-a5174bcdb72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.699565 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849915b-4965-4bab-b9d3-a5174bcdb72c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.699875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849915b-4965-4bab-b9d3-a5174bcdb72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.700180 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3849915b-4965-4bab-b9d3-a5174bcdb72c admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.700898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849915b-4965-4bab-b9d3-a5174bcdb72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.701802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87506dd1-13c4-4020-bd68-5f421d8bf458 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.702474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3849915b-4965-4bab-b9d3-a5174bcdb72c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.703505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87506dd1-13c4-4020-bd68-5f421d8bf458 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.712972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 795/1600] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:45.713993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849915b-4965-4bab-b9d3-a5174bcdb72c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.714600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 806/1601] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:45.715283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87506dd1-13c4-4020-bd68-5f421d8bf458 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.725894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3849915b-4965-4bab-b9d3-a5174bcdb72c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.726229 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87506dd1-13c4-4020-bd68-5f421d8bf458 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.731231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ab772-9414-488d-9c66-24a3d417dadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.731388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75557c9d-0288-435c-8b34-0977225d82fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.732049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ab772-9414-488d-9c66-24a3d417dadf admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.732265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75557c9d-0288-435c-8b34-0977225d82fe admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.732366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75557c9d-0288-435c-8b34-0977225d82fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.732469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ab772-9414-488d-9c66-24a3d417dadf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.732587 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75557c9d-0288-435c-8b34-0977225d82fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.732852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ab772-9414-488d-9c66-24a3d417dadf admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.733309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75557c9d-0288-435c-8b34-0977225d82fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.733698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ab772-9414-488d-9c66-24a3d417dadf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.735633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75557c9d-0288-435c-8b34-0977225d82fe admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.736347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ab772-9414-488d-9c66-24a3d417dadf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.746626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 796/1602] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:45.750857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 807/1603] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:45.750999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d52f-1163-435d-a478-8c754756d0a2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.751097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ab772-9414-488d-9c66-24a3d417dadf admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.751231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d52f-1163-435d-a478-8c754756d0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.751231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4d52f-1163-435d-a478-8c754756d0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.752974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-937ab772-9414-488d-9c66-24a3d417dadf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:45.768035 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-32b4d52f-1163-435d-a478-8c754756d0a2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:45.769352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-32b4d52f-1163-435d-a478-8c754756d0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:45.778739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 797/1604] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:45.779639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4d52f-1163-435d-a478-8c754756d0a2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.792961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4d52f-1163-435d-a478-8c754756d0a2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.799293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4758e08-387a-4baa-9613-07d935b20619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.800344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758e08-387a-4baa-9613-07d935b20619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.800937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758e08-387a-4baa-9613-07d935b20619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.801284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4758e08-387a-4baa-9613-07d935b20619 admin admin] PATH_INFO: `/v3/projects/d1d6281ef1ee484dbcdde72e5fd9a3a3/users/cba8bed30c5f417b866c413f245b0cef/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.818782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4758e08-387a-4baa-9613-07d935b20619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d6281ef1ee484dbcdde72e5fd9a3a3, user_id=cba8bed30c5f417b866c413f245b0cef, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.821490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4758e08-387a-4baa-9613-07d935b20619 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.829696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ab772-9414-488d-9c66-24a3d417dadf admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.832612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dbe51-5c3c-43f4-a3ed-fe0e6d731001 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.832839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dbe51-5c3c-43f4-a3ed-fe0e6d731001 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.833142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dbe51-5c3c-43f4-a3ed-fe0e6d731001 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.833424 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1dbe51-5c3c-43f4-a3ed-fe0e6d731001 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.844636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dbe51-5c3c-43f4-a3ed-fe0e6d731001 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.845643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1dbe51-5c3c-43f4-a3ed-fe0e6d731001 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.857008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 808/1605] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:45.857915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dbe51-5c3c-43f4-a3ed-fe0e6d731001 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.873108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1dbe51-5c3c-43f4-a3ed-fe0e6d731001 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.878763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf5715-b959-4881-8651-c59dc4acf04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.879432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5715-b959-4881-8651-c59dc4acf04a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.879719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5715-b959-4881-8651-c59dc4acf04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.880030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf5715-b959-4881-8651-c59dc4acf04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.880923 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf5715-b959-4881-8651-c59dc4acf04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.882523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bf5715-b959-4881-8651-c59dc4acf04a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:45.898910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 809/1606] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:45.900340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf5715-b959-4881-8651-c59dc4acf04a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.911742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf5715-b959-4881-8651-c59dc4acf04a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:45.919182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 798/1607] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:45 2022] PUT /identity/v3/projects/d1d6281ef1ee484dbcdde72e5fd9a3a3/users/cba8bed30c5f417b866c413f245b0cef/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:45.920135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4758e08-387a-4baa-9613-07d935b20619 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:45.926032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:45.959315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:45.987866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde9302-3c37-4e97-95ab-e4ccee02f99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:45.988655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde9302-3c37-4e97-95ab-e4ccee02f99e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:45.989004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde9302-3c37-4e97-95ab-e4ccee02f99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:45.989286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffde9302-3c37-4e97-95ab-e4ccee02f99e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:45.990044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde9302-3c37-4e97-95ab-e4ccee02f99e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:45.991704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffde9302-3c37-4e97-95ab-e4ccee02f99e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:46.008104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 810/1608] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:46.009132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde9302-3c37-4e97-95ab-e4ccee02f99e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:46.010986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4758e08-387a-4baa-9613-07d935b20619 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:46.015846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771ad63-3fc9-4942-9c8b-93906b224975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:46.016869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771ad63-3fc9-4942-9c8b-93906b224975 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.017178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771ad63-3fc9-4942-9c8b-93906b224975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.017463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771ad63-3fc9-4942-9c8b-93906b224975 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.018204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771ad63-3fc9-4942-9c8b-93906b224975 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:46.019856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771ad63-3fc9-4942-9c8b-93906b224975 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:46.020457 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffde9302-3c37-4e97-95ab-e4ccee02f99e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:46.027987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d06ce-d01b-4ecb-bb74-40f783ea8f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:46.033860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d06ce-d01b-4ecb-bb74-40f783ea8f4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.033860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d06ce-d01b-4ecb-bb74-40f783ea8f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.033860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d06ce-d01b-4ecb-bb74-40f783ea8f4f admin admin] PATH_INFO: `/v3/projects/95b80056fd6a46abb2ebb9a6a3bcb689/users/66801c15461d4b419949b4959805306a/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.034105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 799/1609] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:46.034105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771ad63-3fc9-4942-9c8b-93906b224975 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:46.051904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d06ce-d01b-4ecb-bb74-40f783ea8f4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=95b80056fd6a46abb2ebb9a6a3bcb689, user_id=66801c15461d4b419949b4959805306a, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:46.054864 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d06ce-d01b-4ecb-bb74-40f783ea8f4f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:46.095892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771ad63-3fc9-4942-9c8b-93906b224975 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:46.099725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da271d44-ab25-4abe-8068-e072f040f73c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:46.100561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271d44-ab25-4abe-8068-e072f040f73c service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.100936 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271d44-ab25-4abe-8068-e072f040f73c service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.101312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da271d44-ab25-4abe-8068-e072f040f73c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.111588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da271d44-ab25-4abe-8068-e072f040f73c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:46.113894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da271d44-ab25-4abe-8068-e072f040f73c service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:46.124163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 800/1610] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:46.125742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da271d44-ab25-4abe-8068-e072f040f73c service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:46.136170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da271d44-ab25-4abe-8068-e072f040f73c service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:46.144786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 811/1611] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:46 2022] PUT /identity/v3/projects/95b80056fd6a46abb2ebb9a6a3bcb689/users/66801c15461d4b419949b4959805306a/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:46.144786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c0e1-fdfc-42f5-968c-dba675a35a3d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.144786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c0e1-fdfc-42f5-968c-dba675a35a3d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.144786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff3c0e1-fdfc-42f5-968c-dba675a35a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.170759 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-aff3c0e1-fdfc-42f5-968c-dba675a35a3d None None] MFA Rules not processed for user `cba8bed30c5f417b866c413f245b0cef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:46.172627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aff3c0e1-fdfc-42f5-968c-dba675a35a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:46.203180 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3e811-e290-4ab1-96df-ce20f2a2de74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:46.206976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3e811-e290-4ab1-96df-ce20f2a2de74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.206976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3e811-e290-4ab1-96df-ce20f2a2de74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.206976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3e811-e290-4ab1-96df-ce20f2a2de74 admin admin] PATH_INFO: `/v3/projects/eacd694fb0c9467ca558e578151700b4/users/9dbbfc0772104ed6af5c8cf8d406f64b/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.221751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3e811-e290-4ab1-96df-ce20f2a2de74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eacd694fb0c9467ca558e578151700b4, user_id=9dbbfc0772104ed6af5c8cf8d406f64b, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:46.224916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3e811-e290-4ab1-96df-ce20f2a2de74 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:46.244939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 812/1612] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:46.245832 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c0e1-fdfc-42f5-968c-dba675a35a3d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:46.258588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff3c0e1-fdfc-42f5-968c-dba675a35a3d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:46.263733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4ed1f-269f-4877-bcef-84113111bf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:46.264740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4ed1f-269f-4877-bcef-84113111bf55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.265091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4ed1f-269f-4877-bcef-84113111bf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.265463 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4ed1f-269f-4877-bcef-84113111bf55 admin admin] PATH_INFO: `/v3/projects/82b4e98c01904b04927afc617de8b11c/users/c1c4f2a6178140858efd4599a3f975d6/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.284460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4ed1f-269f-4877-bcef-84113111bf55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82b4e98c01904b04927afc617de8b11c, user_id=c1c4f2a6178140858efd4599a3f975d6, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:46.288360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4ed1f-269f-4877-bcef-84113111bf55 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:46.356112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 801/1613] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:46 2022] PUT /identity/v3/projects/eacd694fb0c9467ca558e578151700b4/users/9dbbfc0772104ed6af5c8cf8d406f64b/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:46.361223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3e811-e290-4ab1-96df-ce20f2a2de74 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:46.383940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 813/1614] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:46 2022] PUT /identity/v3/projects/82b4e98c01904b04927afc617de8b11c/users/c1c4f2a6178140858efd4599a3f975d6/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:46.392812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb08e4-9d07-4df4-a4eb-5e41250df4f8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.392812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb08e4-9d07-4df4-a4eb-5e41250df4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.392812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb08e4-9d07-4df4-a4eb-5e41250df4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.402761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ffbb08e4-9d07-4df4-a4eb-5e41250df4f8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:46.404036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ffbb08e4-9d07-4df4-a4eb-5e41250df4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:46.425176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3e811-e290-4ab1-96df-ce20f2a2de74 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:46.465395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:46.471505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 814/1615] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:46.472901 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb08e4-9d07-4df4-a4eb-5e41250df4f8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:46.482338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbb08e4-9d07-4df4-a4eb-5e41250df4f8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:46.489950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3dc14-f29b-4b9c-9c08-0f3deb729095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:46.490994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3dc14-f29b-4b9c-9c08-0f3deb729095 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.492518 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3dc14-f29b-4b9c-9c08-0f3deb729095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.492891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3dc14-f29b-4b9c-9c08-0f3deb729095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.493638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3dc14-f29b-4b9c-9c08-0f3deb729095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:46.496196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed3dc14-f29b-4b9c-9c08-0f3deb729095 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:46.511409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:46.516845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb0c59e-20e0-4454-a9af-8a8f2800904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:46.518288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0c59e-20e0-4454-a9af-8a8f2800904a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.518288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0c59e-20e0-4454-a9af-8a8f2800904a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.518522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb0c59e-20e0-4454-a9af-8a8f2800904a admin admin] PATH_INFO: `/v3/projects/659dfa7be64142adaca0371da26a7830/users/996d28f48fd44a24b8f265eef0143add/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.538477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0c59e-20e0-4454-a9af-8a8f2800904a admin admin] RBAC: Authorizing `identity:create_grant(project_id=659dfa7be64142adaca0371da26a7830, user_id=996d28f48fd44a24b8f265eef0143add, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:46.541541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb0c59e-20e0-4454-a9af-8a8f2800904a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:46.625977 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 815/1616] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:46 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:46.630280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54991d-b737-45a8-ab5d-714fdb9c107c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.630568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54991d-b737-45a8-ab5d-714fdb9c107c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.630842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c54991d-b737-45a8-ab5d-714fdb9c107c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.655173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3c54991d-b737-45a8-ab5d-714fdb9c107c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:46.656095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 802/1617] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:46 2022] PUT /identity/v3/projects/659dfa7be64142adaca0371da26a7830/users/996d28f48fd44a24b8f265eef0143add/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:46.657799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360691fe-2e61-4113-b22d-3336a4cd9f6d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.658193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360691fe-2e61-4113-b22d-3336a4cd9f6d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.658527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360691fe-2e61-4113-b22d-3336a4cd9f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.676902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3c54991d-b737-45a8-ab5d-714fdb9c107c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:46.681306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-360691fe-2e61-4113-b22d-3336a4cd9f6d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:46.682641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-360691fe-2e61-4113-b22d-3336a4cd9f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:46.792837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 803/1618] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:46.794095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360691fe-2e61-4113-b22d-3336a4cd9f6d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:46.805922 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 816/1619] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:46.805922 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54991d-b737-45a8-ab5d-714fdb9c107c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:46.820449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c54991d-b737-45a8-ab5d-714fdb9c107c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:46.829346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55982195-f3cf-424b-a820-064402314154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:46.829346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55982195-f3cf-424b-a820-064402314154 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.829346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55982195-f3cf-424b-a820-064402314154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.829346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55982195-f3cf-424b-a820-064402314154 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.829826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55982195-f3cf-424b-a820-064402314154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:46.832925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55982195-f3cf-424b-a820-064402314154 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:46.920016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360691fe-2e61-4113-b22d-3336a4cd9f6d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:46.923787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b435ab-1dff-46cf-81b7-585aebac9c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:46.924516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b435ab-1dff-46cf-81b7-585aebac9c38 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.924801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b435ab-1dff-46cf-81b7-585aebac9c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.925080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b435ab-1dff-46cf-81b7-585aebac9c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.934955 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b435ab-1dff-46cf-81b7-585aebac9c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:46.936445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b435ab-1dff-46cf-81b7-585aebac9c38 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:46.943147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:46.951367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 804/1620] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:46.953443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b82e-1067-47e4-9b88-5ece52e06725 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:46.953816 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b82e-1067-47e4-9b88-5ece52e06725 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:46.954131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719b82e-1067-47e4-9b88-5ece52e06725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:46.978527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 817/1621] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:46 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:46.978527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55982195-f3cf-424b-a820-064402314154 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:47.007539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b719b82e-1067-47e4-9b88-5ece52e06725 None None] MFA Rules not processed for user `996d28f48fd44a24b8f265eef0143add`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:47.007747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b719b82e-1067-47e4-9b88-5ece52e06725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:47.025916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55982195-f3cf-424b-a820-064402314154 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:47.034544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868d2dc-cfa7-4428-a382-aa696a4a8078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:47.035565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868d2dc-cfa7-4428-a382-aa696a4a8078 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.035856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868d2dc-cfa7-4428-a382-aa696a4a8078 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.036179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868d2dc-cfa7-4428-a382-aa696a4a8078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.078008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868d2dc-cfa7-4428-a382-aa696a4a8078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:47.080783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868d2dc-cfa7-4428-a382-aa696a4a8078 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:47.096247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 818/1622] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:47.098084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868d2dc-cfa7-4428-a382-aa696a4a8078 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:47.110319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868d2dc-cfa7-4428-a382-aa696a4a8078 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:47.121558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd8e61-600d-4d03-a664-17a5c6e63cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:47.121558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd8e61-600d-4d03-a664-17a5c6e63cae service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.121558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd8e61-600d-4d03-a664-17a5c6e63cae service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.121558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd8e61-600d-4d03-a664-17a5c6e63cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.136700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 805/1623] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:47.138575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b82e-1067-47e4-9b88-5ece52e06725 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:47.146478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd8e61-600d-4d03-a664-17a5c6e63cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:47.151195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffd8e61-600d-4d03-a664-17a5c6e63cae service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:47.163528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b719b82e-1067-47e4-9b88-5ece52e06725 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:47.172520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791f036-98e5-4879-a3f2-a4be1518a387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:47.173383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791f036-98e5-4879-a3f2-a4be1518a387 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.173689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791f036-98e5-4879-a3f2-a4be1518a387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.174013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1791f036-98e5-4879-a3f2-a4be1518a387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.177403 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791f036-98e5-4879-a3f2-a4be1518a387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:47.177545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 819/1624] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:47.177642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1791f036-98e5-4879-a3f2-a4be1518a387 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:47.177726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd8e61-600d-4d03-a664-17a5c6e63cae service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:47.193303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 806/1625] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:47.194288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791f036-98e5-4879-a3f2-a4be1518a387 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:47.201247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd8e61-600d-4d03-a664-17a5c6e63cae service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:47.207095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1791f036-98e5-4879-a3f2-a4be1518a387 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:47.212179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c6223-2e5d-449c-8bba-6dcb77c9986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:47.213091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf028e-bc49-44bb-8538-5f139a1cf3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:47.213244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c6223-2e5d-449c-8bba-6dcb77c9986f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.213750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c6223-2e5d-449c-8bba-6dcb77c9986f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.213865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf028e-bc49-44bb-8538-5f139a1cf3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.214029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9c6223-2e5d-449c-8bba-6dcb77c9986f admin admin] PATH_INFO: `/v3/projects/afe914fbaa994f5c831b5262edece089/users/710d01422fb84b4289dbabe3003ebbe5/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.214131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf028e-bc49-44bb-8538-5f139a1cf3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.214342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf028e-bc49-44bb-8538-5f139a1cf3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.215030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf028e-bc49-44bb-8538-5f139a1cf3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:47.220376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf028e-bc49-44bb-8538-5f139a1cf3a6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:47.238425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c6223-2e5d-449c-8bba-6dcb77c9986f admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe914fbaa994f5c831b5262edece089, user_id=710d01422fb84b4289dbabe3003ebbe5, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:47.238425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9c6223-2e5d-449c-8bba-6dcb77c9986f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:47.356298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 820/1627] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:47 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:47.356572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 807/1627] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:47 2022] PUT /identity/v3/projects/afe914fbaa994f5c831b5262edece089/users/710d01422fb84b4289dbabe3003ebbe5/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:47.357886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c6223-2e5d-449c-8bba-6dcb77c9986f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:47.358557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be14b3-8cf9-4383-9eff-fcc6097f4050 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.359891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be14b3-8cf9-4383-9eff-fcc6097f4050 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.359891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be14b3-8cf9-4383-9eff-fcc6097f4050 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.361293 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 821/1628] 10.222.0.85 () {54 vars in 962 bytes} [Wed Jul 20 22:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:09:47.362139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be14b3-8cf9-4383-9eff-fcc6097f4050 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:47.462841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9c6223-2e5d-449c-8bba-6dcb77c9986f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:47.484318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98b7d5-8a54-4073-9a1b-f5ab46631f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:47.484956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be14b3-8cf9-4383-9eff-fcc6097f4050 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:47.485379 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b7d5-8a54-4073-9a1b-f5ab46631f40 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.485717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b7d5-8a54-4073-9a1b-f5ab46631f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.486123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98b7d5-8a54-4073-9a1b-f5ab46631f40 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.487086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98b7d5-8a54-4073-9a1b-f5ab46631f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:47.490063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98b7d5-8a54-4073-9a1b-f5ab46631f40 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:47.493398 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae148c-d3ce-475a-b17b-7d7aa8a55473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:47.494078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae148c-d3ce-475a-b17b-7d7aa8a55473 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.494364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae148c-d3ce-475a-b17b-7d7aa8a55473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.494642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae148c-d3ce-475a-b17b-7d7aa8a55473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.495377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae148c-d3ce-475a-b17b-7d7aa8a55473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:47.497325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae148c-d3ce-475a-b17b-7d7aa8a55473 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:47.527063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 822/1629] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:47.527063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d46533-aed8-4414-926a-17234951bc14 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.527063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d46533-aed8-4414-926a-17234951bc14 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.527063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d46533-aed8-4414-926a-17234951bc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.565433 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c2d46533-aed8-4414-926a-17234951bc14 None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:47.567212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c2d46533-aed8-4414-926a-17234951bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:47.587177 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:47.599142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 808/1630] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:47 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:47.599142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98b7d5-8a54-4073-9a1b-f5ab46631f40 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:47.624313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98b7d5-8a54-4073-9a1b-f5ab46631f40 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:47.642575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287902ed-a4cb-46a5-85ae-3c353af6e184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:47.643492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287902ed-a4cb-46a5-85ae-3c353af6e184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.643780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287902ed-a4cb-46a5-85ae-3c353af6e184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.644086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287902ed-a4cb-46a5-85ae-3c353af6e184 admin admin] PATH_INFO: `/v3/projects/afe914fbaa994f5c831b5262edece089/users/710d01422fb84b4289dbabe3003ebbe5/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.647492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287902ed-a4cb-46a5-85ae-3c353af6e184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afe914fbaa994f5c831b5262edece089, user_id=710d01422fb84b4289dbabe3003ebbe5, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:47.650731 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287902ed-a4cb-46a5-85ae-3c353af6e184 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:47.678499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 823/1631] 10.222.0.85 () {58 vars in 1059 bytes} [Wed Jul 20 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:47.679241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d46533-aed8-4414-926a-17234951bc14 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:47.689299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 809/1632] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:47 2022] PUT /identity/v3/projects/afe914fbaa994f5c831b5262edece089/users/710d01422fb84b4289dbabe3003ebbe5/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:47.690911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d51dc8-d9c1-414d-88c7-04b1befbe375 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.691213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d51dc8-d9c1-414d-88c7-04b1befbe375 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.691499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d51dc8-d9c1-414d-88c7-04b1befbe375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.707119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d46533-aed8-4414-926a-17234951bc14 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:47.726479 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d0d51dc8-d9c1-414d-88c7-04b1befbe375 None None] MFA Rules not processed for user `710d01422fb84b4289dbabe3003ebbe5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:47.727744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d0d51dc8-d9c1-414d-88c7-04b1befbe375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:47.762753 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:47.814323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5858a460-1a64-4819-96d4-4c4bbd8ea0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:47.814942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858a460-1a64-4819-96d4-4c4bbd8ea0bc admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.815214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858a460-1a64-4819-96d4-4c4bbd8ea0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.815788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5858a460-1a64-4819-96d4-4c4bbd8ea0bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.816252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858a460-1a64-4819-96d4-4c4bbd8ea0bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:47.817895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5858a460-1a64-4819-96d4-4c4bbd8ea0bc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:47.836164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 824/1633] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:47.836164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dec3d-f3b5-471d-b089-442bbd6a498b None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.836164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dec3d-f3b5-471d-b089-442bbd6a498b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.836164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9dec3d-f3b5-471d-b089-442bbd6a498b None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.837599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 825/1634] 10.222.0.85 () {54 vars in 912 bytes} [Wed Jul 20 22:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:09:47.838320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dec3d-f3b5-471d-b089-442bbd6a498b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:47.853362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9dec3d-f3b5-471d-b089-442bbd6a498b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:47.857005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 810/1635] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:47.858921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a5cfd-f1a1-4f11-bc8f-6ad22a7f168a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:47.859986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c6b1f-9591-4422-ab35-8b2d6ae6b6d3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.860481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c6b1f-9591-4422-ab35-8b2d6ae6b6d3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.861150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5cfd-f1a1-4f11-bc8f-6ad22a7f168a admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:47.861469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c6b1f-9591-4422-ab35-8b2d6ae6b6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.861750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5cfd-f1a1-4f11-bc8f-6ad22a7f168a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:47.862165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a5cfd-f1a1-4f11-bc8f-6ad22a7f168a admin admin] PATH_INFO: `/v3/projects/77da6a994439438789658a6a62fde106/users/d5fb90ef49624843894108cecad3822f/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:47.888049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-542c6b1f-9591-4422-ab35-8b2d6ae6b6d3 None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:47.889912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-542c6b1f-9591-4422-ab35-8b2d6ae6b6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:47.904214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a5cfd-f1a1-4f11-bc8f-6ad22a7f168a admin admin] RBAC: Authorizing `identity:create_grant(project_id=77da6a994439438789658a6a62fde106, user_id=d5fb90ef49624843894108cecad3822f, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:47.912400 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a5cfd-f1a1-4f11-bc8f-6ad22a7f168a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:47.988774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 811/1636] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:09:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:47.990142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c6b1f-9591-4422-ab35-8b2d6ae6b6d3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:48.043263 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 826/1637] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:47 2022] PUT /identity/v3/projects/77da6a994439438789658a6a62fde106/users/d5fb90ef49624843894108cecad3822f/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:48.044190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a5cfd-f1a1-4f11-bc8f-6ad22a7f168a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:48.074062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c6b1f-9591-4422-ab35-8b2d6ae6b6d3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:48.126793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a5cfd-f1a1-4f11-bc8f-6ad22a7f168a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:48.132178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055c812-1043-4efe-9ef2-222579b806ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:48.132990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055c812-1043-4efe-9ef2-222579b806ed service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:48.133373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055c812-1043-4efe-9ef2-222579b806ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:48.134587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055c812-1043-4efe-9ef2-222579b806ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:48.152581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b4103-5e2f-49fa-9ff7-14bc058af775 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:48.153623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b4103-5e2f-49fa-9ff7-14bc058af775 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:48.154200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b4103-5e2f-49fa-9ff7-14bc058af775 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:48.154699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5b4103-5e2f-49fa-9ff7-14bc058af775 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:48.229355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055c812-1043-4efe-9ef2-222579b806ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:48.231028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055c812-1043-4efe-9ef2-222579b806ed service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:48.252430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 827/1638] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:48.253854 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055c812-1043-4efe-9ef2-222579b806ed service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:48.263310 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b4103-5e2f-49fa-9ff7-14bc058af775 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:48.267647 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5b4103-5e2f-49fa-9ff7-14bc058af775 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:48.296695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 812/1639] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:47 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:48.393739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055c812-1043-4efe-9ef2-222579b806ed service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:48.411298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bda75-fbb0-4ba9-bb4c-a8d3359c77da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:48.411298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bda75-fbb0-4ba9-bb4c-a8d3359c77da admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:48.411298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bda75-fbb0-4ba9-bb4c-a8d3359c77da admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:48.411298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bda75-fbb0-4ba9-bb4c-a8d3359c77da admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:48.413827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bda75-fbb0-4ba9-bb4c-a8d3359c77da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:48.420992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bda75-fbb0-4ba9-bb4c-a8d3359c77da admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:48.429725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:48.454581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 828/1640] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:09:48.458856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b4103-5e2f-49fa-9ff7-14bc058af775 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:48.474762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5b4103-5e2f-49fa-9ff7-14bc058af775 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:48.487815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34db5c54-d36c-4048-b4fe-59cf9cffb3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:48.489117 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5c54-d36c-4048-b4fe-59cf9cffb3df admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:48.489648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5c54-d36c-4048-b4fe-59cf9cffb3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:48.490563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34db5c54-d36c-4048-b4fe-59cf9cffb3df admin admin] PATH_INFO: `/v3/projects/77da6a994439438789658a6a62fde106/users/d5fb90ef49624843894108cecad3822f/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:48.502596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d85af-85fa-4c66-8431-91415fb80985 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:48.502797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db5c54-d36c-4048-b4fe-59cf9cffb3df admin admin] RBAC: Authorizing `identity:create_grant(project_id=77da6a994439438789658a6a62fde106, user_id=d5fb90ef49624843894108cecad3822f, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:48.502896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d85af-85fa-4c66-8431-91415fb80985 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:48.503143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d85af-85fa-4c66-8431-91415fb80985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:48.506123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34db5c54-d36c-4048-b4fe-59cf9cffb3df admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:48.534711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 813/1641] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:48 2022] PUT /identity/v3/projects/77da6a994439438789658a6a62fde106/users/d5fb90ef49624843894108cecad3822f/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:48.774485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b59b1-66ec-40ab-bd34-f978a5b8b603 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:48.774485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b59b1-66ec-40ab-bd34-f978a5b8b603 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:48.774485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b59b1-66ec-40ab-bd34-f978a5b8b603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:48.783762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6c6d85af-85fa-4c66-8431-91415fb80985 None None] MFA Rules not processed for user `f602a2bdf3e1437faacfeeccb1b75d83`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:48.783762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6c6d85af-85fa-4c66-8431-91415fb80985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:48.785699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9e2b59b1-66ec-40ab-bd34-f978a5b8b603 None None] MFA Rules not processed for user `d5fb90ef49624843894108cecad3822f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:48.785699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9e2b59b1-66ec-40ab-bd34-f978a5b8b603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:48.785699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 814/1642] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:09:48.785699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b59b1-66ec-40ab-bd34-f978a5b8b603 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:48.787056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 829/1643] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:48 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:09:48.787056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d85af-85fa-4c66-8431-91415fb80985 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:48.787336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:48.844185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d85af-85fa-4c66-8431-91415fb80985 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:48.846341 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b59b1-66ec-40ab-bd34-f978a5b8b603 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:48.853227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a734536-9ab4-4d69-b12b-4a0bab5024b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:48.854017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a734536-9ab4-4d69-b12b-4a0bab5024b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:48.854406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a734536-9ab4-4d69-b12b-4a0bab5024b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:48.854782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a734536-9ab4-4d69-b12b-4a0bab5024b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:48.855602 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a734536-9ab4-4d69-b12b-4a0bab5024b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:48.856760 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a3f9d-46f5-4216-8cef-283270465429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:48.857482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a3f9d-46f5-4216-8cef-283270465429 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:48.857771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a3f9d-46f5-4216-8cef-283270465429 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:48.858055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a734536-9ab4-4d69-b12b-4a0bab5024b0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:48.858177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a3f9d-46f5-4216-8cef-283270465429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:48.918338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a3f9d-46f5-4216-8cef-283270465429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:48.919808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a3f9d-46f5-4216-8cef-283270465429 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:48.930005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 815/1644] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:49.035996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 830/1645] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:48 2022] POST /identity/v3/projects => generated 403 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:49.040292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a3f9d-46f5-4216-8cef-283270465429 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:49.056035 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a3f9d-46f5-4216-8cef-283270465429 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:49.153317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0ea4-408d-44a8-864c-13cc19b66010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:49.153317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0ea4-408d-44a8-864c-13cc19b66010 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:49.153317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0ea4-408d-44a8-864c-13cc19b66010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:49.153584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c0ea4-408d-44a8-864c-13cc19b66010 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:49.154237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c0ea4-408d-44a8-864c-13cc19b66010 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:49.158339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c0ea4-408d-44a8-864c-13cc19b66010 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:49.287338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 816/1646] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:49 2022] POST /identity/v3/users => generated 308 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:49.291041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a734536-9ab4-4d69-b12b-4a0bab5024b0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:49.303636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a734536-9ab4-4d69-b12b-4a0bab5024b0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:49.309851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6625-0610-4cb8-9d21-fe298de10ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:49.311310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6625-0610-4cb8-9d21-fe298de10ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:49.311730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6625-0610-4cb8-9d21-fe298de10ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:49.312152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b6625-0610-4cb8-9d21-fe298de10ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:49.313163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6625-0610-4cb8-9d21-fe298de10ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:49.316743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330b6625-0610-4cb8-9d21-fe298de10ab2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:49.333617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 831/1647] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:09:49.338710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0ea4-408d-44a8-864c-13cc19b66010 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:49.351452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c0ea4-408d-44a8-864c-13cc19b66010 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:49.362871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0784-6a17-4fb0-91d4-a79ecc8ae6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:49.362871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0784-6a17-4fb0-91d4-a79ecc8ae6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:49.362871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0784-6a17-4fb0-91d4-a79ecc8ae6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:49.362871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a0784-6a17-4fb0-91d4-a79ecc8ae6c9 admin admin] PATH_INFO: `/v3/projects/bcd64cf0c8394013b24ae23fa2e4640e/users/9773d26fbd584415b0d79dc51cf069a8/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:49.378669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6625-0610-4cb8-9d21-fe298de10ab2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:49.389064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a0784-6a17-4fb0-91d4-a79ecc8ae6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd64cf0c8394013b24ae23fa2e4640e, user_id=9773d26fbd584415b0d79dc51cf069a8, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:49.393277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a0784-6a17-4fb0-91d4-a79ecc8ae6c9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:49.441339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b6625-0610-4cb8-9d21-fe298de10ab2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:49.444990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363f09-cc97-4236-8ffa-15658c01af02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:49.445681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363f09-cc97-4236-8ffa-15658c01af02 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:49.445959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363f09-cc97-4236-8ffa-15658c01af02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:49.446255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00363f09-cc97-4236-8ffa-15658c01af02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:49.483551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:49.528234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 817/1648] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:49 2022] PUT /identity/v3/projects/bcd64cf0c8394013b24ae23fa2e4640e/users/9773d26fbd584415b0d79dc51cf069a8/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:49.533958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0784-6a17-4fb0-91d4-a79ecc8ae6c9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:49.565710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00363f09-cc97-4236-8ffa-15658c01af02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:49.568007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00363f09-cc97-4236-8ffa-15658c01af02 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:49.584717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 832/1649] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:49.652293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a0784-6a17-4fb0-91d4-a79ecc8ae6c9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:49.662627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7ad7e-cad2-41c6-aefc-209a52a1ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:49.664053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7ad7e-cad2-41c6-aefc-209a52a1ad39 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:49.664590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7ad7e-cad2-41c6-aefc-209a52a1ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:49.665218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7ad7e-cad2-41c6-aefc-209a52a1ad39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:49.666262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7ad7e-cad2-41c6-aefc-209a52a1ad39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:49.668269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7ad7e-cad2-41c6-aefc-209a52a1ad39 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:49.698374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 818/1650] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:09:49.700309 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363f09-cc97-4236-8ffa-15658c01af02 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:49.715611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00363f09-cc97-4236-8ffa-15658c01af02 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:49.725378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ca9e59-6f70-42b9-a360-3bb4a84890e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:49.726660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca9e59-6f70-42b9-a360-3bb4a84890e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:49.727195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca9e59-6f70-42b9-a360-3bb4a84890e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:49.729267 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ca9e59-6f70-42b9-a360-3bb4a84890e2 admin admin] PATH_INFO: `/v3/projects/bcd64cf0c8394013b24ae23fa2e4640e/users/9773d26fbd584415b0d79dc51cf069a8/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:49.732224 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca9e59-6f70-42b9-a360-3bb4a84890e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcd64cf0c8394013b24ae23fa2e4640e, user_id=9773d26fbd584415b0d79dc51cf069a8, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:49.736762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ca9e59-6f70-42b9-a360-3bb4a84890e2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:49.760970 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:49.769234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 833/1651] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:49 2022] PUT /identity/v3/projects/bcd64cf0c8394013b24ae23fa2e4640e/users/9773d26fbd584415b0d79dc51cf069a8/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:49.952154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7ad7e-cad2-41c6-aefc-209a52a1ad39 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:50.105811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7ad7e-cad2-41c6-aefc-209a52a1ad39 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:50.185666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdfc4e-53a8-452e-a0bb-09f752e21156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:50.186953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdfc4e-53a8-452e-a0bb-09f752e21156 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:50.188496 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdfc4e-53a8-452e-a0bb-09f752e21156 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:50.189822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdfc4e-53a8-452e-a0bb-09f752e21156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:50.257666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdfc4e-53a8-452e-a0bb-09f752e21156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:50.259772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdfc4e-53a8-452e-a0bb-09f752e21156 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:50.273573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 819/1652] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:51.174572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:52.734083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c54e4-b613-4104-8341-124aa4e21e65 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:52.735119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c54e4-b613-4104-8341-124aa4e21e65 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:52.735325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c54e4-b613-4104-8341-124aa4e21e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:52.861143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c79c54e4-b613-4104-8341-124aa4e21e65 None None] MFA Rules not processed for user `9773d26fbd584415b0d79dc51cf069a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:52.865117 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c79c54e4-b613-4104-8341-124aa4e21e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:53.052540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:53.144708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 834/1653] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:52 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:53.480008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdfc4e-53a8-452e-a0bb-09f752e21156 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:53.604042 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdfc4e-53a8-452e-a0bb-09f752e21156 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:53.622398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:53.624174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:53.624470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:53.628228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] PATH_INFO: `/v3/users/083a9b6e9e0e4091957c13ce23809b95` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:53.629786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=083a9b6e9e0e4091957c13ce23809b95)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:53.631757 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:53.840531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c54e4-b613-4104-8341-124aa4e21e65 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:53.859715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c54e4-b613-4104-8341-124aa4e21e65 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:53.874366 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:53.875524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:53.875809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:53.876114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] PATH_INFO: `/v3/users/cba8bed30c5f417b866c413f245b0cef` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:53.880770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cba8bed30c5f417b866c413f245b0cef)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:53.882039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: WARNING py.warnings [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:09:53.882039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: warnings.warn(msg) Jul 20 22:09:53.882039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: Jul 20 22:09:53.883274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:53.934505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '083a9b6e9e0e4091957c13ce23809b95'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:53.942876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:53.969510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '083a9b6e9e0e4091957c13ce23809b95'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:53.997305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '083a9b6e9e0e4091957c13ce23809b95'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:53.999444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '083a9b6e9e0e4091957c13ce23809b95'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:54.001625 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eae14c11-4538-4669-8915-cfb74cd11ab7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '083a9b6e9e0e4091957c13ce23809b95'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:54.096902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 820/1654] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:09:53 2022] DELETE /identity/v3/users/083a9b6e9e0e4091957c13ce23809b95 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:54.101618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a26868-259e-4331-be0a-22e4bef53f15 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:54.102114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a26868-259e-4331-be0a-22e4bef53f15 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:54.102550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a26868-259e-4331-be0a-22e4bef53f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:54.140020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-65a26868-259e-4331-be0a-22e4bef53f15 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:54.142566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-65a26868-259e-4331-be0a-22e4bef53f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:54.184463 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cba8bed30c5f417b866c413f245b0cef'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:54.270515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 821/1655] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:54.291312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cba8bed30c5f417b866c413f245b0cef'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:54.314248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cba8bed30c5f417b866c413f245b0cef'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:54.315093 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cba8bed30c5f417b866c413f245b0cef'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:54.363798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cba8bed30c5f417b866c413f245b0cef'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:54.375418 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 835/1656] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:09:53 2022] DELETE /identity/v3/users/cba8bed30c5f417b866c413f245b0cef => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:54.380185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90138-e5d5-4e3a-b0b4-ff5fc548522e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:54.383513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90138-e5d5-4e3a-b0b4-ff5fc548522e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:54.383513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f90138-e5d5-4e3a-b0b4-ff5fc548522e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:54.392689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:54.398141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:54.441323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b3f90138-e5d5-4e3a-b0b4-ff5fc548522e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:54.452510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b3f90138-e5d5-4e3a-b0b4-ff5fc548522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:54.596948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfcee6-0078-4912-90bf-c14e0f4d6923 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:54.607314 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54cad-9c08-46b3-b2d9-075b5b336357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:54.608630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54cad-9c08-46b3-b2d9-075b5b336357 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:54.609553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54cad-9c08-46b3-b2d9-075b5b336357 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:54.612353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c54cad-9c08-46b3-b2d9-075b5b336357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:54.621202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d6c54cad-9c08-46b3-b2d9-075b5b336357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:54.673343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 822/1657] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:54.764826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90138-e5d5-4e3a-b0b4-ff5fc548522e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:54.767653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b3f90138-e5d5-4e3a-b0b4-ff5fc548522e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:54.809649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f90138-e5d5-4e3a-b0b4-ff5fc548522e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:54.816321 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb166dd9-0acb-4979-a894-f38865fc18a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:54.817126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb166dd9-0acb-4979-a894-f38865fc18a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:54.818088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb166dd9-0acb-4979-a894-f38865fc18a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:54.818506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb166dd9-0acb-4979-a894-f38865fc18a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:54.827042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c54cad-9c08-46b3-b2d9-075b5b336357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:54.831500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c54cad-9c08-46b3-b2d9-075b5b336357 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:54.833906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb166dd9-0acb-4979-a894-f38865fc18a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:54.835790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb166dd9-0acb-4979-a894-f38865fc18a8 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:54.857907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 836/1658] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:54.864282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 823/1659] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:56.924047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54cad-9c08-46b3-b2d9-075b5b336357 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:56.925680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d6c54cad-9c08-46b3-b2d9-075b5b336357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:56.947469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c54cad-9c08-46b3-b2d9-075b5b336357 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:56.954041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:56.958327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:56.958327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:56.958327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] PATH_INFO: `/v3/projects/d1d6281ef1ee484dbcdde72e5fd9a3a3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:56.958327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d6281ef1ee484dbcdde72e5fd9a3a3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:56.959436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:56.963843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:57.132163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d6281ef1ee484dbcdde72e5fd9a3a3', 'request_id': 'req-21e0e783-997b-4779-a193-200b40d25cb5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:57.144160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d6281ef1ee484dbcdde72e5fd9a3a3', 'request_id': 'req-21e0e783-997b-4779-a193-200b40d25cb5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:57.258454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d6281ef1ee484dbcdde72e5fd9a3a3', 'request_id': 'req-21e0e783-997b-4779-a193-200b40d25cb5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:57.281692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] The token cache is being invalidate because project d1d6281ef1ee484dbcdde72e5fd9a3a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:09:57.282021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:57.288179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21e0e783-997b-4779-a193-200b40d25cb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:57.290832 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 837/1660] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:09:56 2022] DELETE /identity/v3/projects/d1d6281ef1ee484dbcdde72e5fd9a3a3 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:57.294998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb166dd9-0acb-4979-a894-f38865fc18a8 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:57.307101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb166dd9-0acb-4979-a894-f38865fc18a8 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:57.453810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:57.485433 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:57.486333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:57.486616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:57.486887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] PATH_INFO: `/v3/users/710d01422fb84b4289dbabe3003ebbe5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:57.493194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=710d01422fb84b4289dbabe3003ebbe5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:57.495203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:57.583159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341945-7b60-419b-bb10-6d081e9789d4 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:57.583440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341945-7b60-419b-bb10-6d081e9789d4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:57.583892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9341945-7b60-419b-bb10-6d081e9789d4 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:57.585933 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 838/1661] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:09:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:09:57.634103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce29d7-57e7-4049-b635-02d715e830d4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:57.636462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce29d7-57e7-4049-b635-02d715e830d4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:57.636923 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce29d7-57e7-4049-b635-02d715e830d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:57.673104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-abce29d7-57e7-4049-b635-02d715e830d4 None None] MFA Rules not processed for user `4e52a3464d8f4a3fa16a102336a4bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:57.674808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-abce29d7-57e7-4049-b635-02d715e830d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:57.779287 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '710d01422fb84b4289dbabe3003ebbe5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:57.810804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '710d01422fb84b4289dbabe3003ebbe5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:57.833951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '710d01422fb84b4289dbabe3003ebbe5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:57.835558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '710d01422fb84b4289dbabe3003ebbe5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:57.836997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73507e74-9acf-4e8f-953a-8e77ce5f49a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '710d01422fb84b4289dbabe3003ebbe5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:57.861694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 839/1662] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:09:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:09:57.861694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce29d7-57e7-4049-b635-02d715e830d4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:57.866695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-abce29d7-57e7-4049-b635-02d715e830d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:57.885006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce29d7-57e7-4049-b635-02d715e830d4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:57.891744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:57.893002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:57.893524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:57.893872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] PATH_INFO: `/v3/projects/3da5a259638149a392b24104efa2ecd4` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:57.899599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3da5a259638149a392b24104efa2ecd4)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:57.902360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:57.918564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 824/1663] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:09:57 2022] DELETE /identity/v3/users/710d01422fb84b4289dbabe3003ebbe5 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:57.920211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d4e2-92b1-42cf-b4ab-696555f5f899 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:57.920719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d4e2-92b1-42cf-b4ab-696555f5f899 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:57.921003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d4e2-92b1-42cf-b4ab-696555f5f899 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:57.925690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 825/1664] 10.222.0.85 () {54 vars in 961 bytes} [Wed Jul 20 22:09:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:09:57.931014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5040de8-a062-4e04-8935-d698f01d32d7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:57.931299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5040de8-a062-4e04-8935-d698f01d32d7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:57.931849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5040de8-a062-4e04-8935-d698f01d32d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:57.976650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e5040de8-a062-4e04-8935-d698f01d32d7 None None] MFA Rules not processed for user `4e52a3464d8f4a3fa16a102336a4bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:57.978438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e5040de8-a062-4e04-8935-d698f01d32d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:58.094646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3da5a259638149a392b24104efa2ecd4', 'request_id': 'req-f8bc55a9-8904-4c1c-819b-f21757c02598'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:58.137749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3da5a259638149a392b24104efa2ecd4', 'request_id': 'req-f8bc55a9-8904-4c1c-819b-f21757c02598'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:58.169892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 826/1665] 10.222.0.85 () {58 vars in 1058 bytes} [Wed Jul 20 22:09:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:58.179555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5040de8-a062-4e04-8935-d698f01d32d7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:58.217172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5040de8-a062-4e04-8935-d698f01d32d7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:58.242237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3da5a259638149a392b24104efa2ecd4', 'request_id': 'req-f8bc55a9-8904-4c1c-819b-f21757c02598'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:58.263464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] The token cache is being invalidate because project 3da5a259638149a392b24104efa2ecd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:09:58.263792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:58.271078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f8bc55a9-8904-4c1c-819b-f21757c02598 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:09:58.271880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 840/1666] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:09:57 2022] DELETE /identity/v3/projects/3da5a259638149a392b24104efa2ecd4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:58.276798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b032-7a66-4850-871f-52ecb1944ffa None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:58.277081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b032-7a66-4850-871f-52ecb1944ffa None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:58.277515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b032-7a66-4850-871f-52ecb1944ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:58.310113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0c88b032-7a66-4850-871f-52ecb1944ffa None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:58.317896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0c88b032-7a66-4850-871f-52ecb1944ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:58.402330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d2ac27-918e-44d9-97d4-716a8c221605 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e52a3464d8f4a3fa16a102336a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:58.405039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2ac27-918e-44d9-97d4-716a8c221605 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:58.405603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2ac27-918e-44d9-97d4-716a8c221605 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:58.406834 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d2ac27-918e-44d9-97d4-716a8c221605 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:58.417604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-46d2ac27-918e-44d9-97d4-716a8c221605 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:58.436695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2ac27-918e-44d9-97d4-716a8c221605 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:58.438800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d2ac27-918e-44d9-97d4-716a8c221605 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:58.472817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 827/1668] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:58.473254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 841/1668] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:09:58.475094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecd8ab-d86c-4085-91ae-bca9f7727359 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:58.475390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecd8ab-d86c-4085-91ae-bca9f7727359 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:58.475854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eecd8ab-d86c-4085-91ae-bca9f7727359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:58.506029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1eecd8ab-d86c-4085-91ae-bca9f7727359 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:58.515132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1eecd8ab-d86c-4085-91ae-bca9f7727359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:58.532215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 828/1669] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:58.533005 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b032-7a66-4850-871f-52ecb1944ffa None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:58.555377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b032-7a66-4850-871f-52ecb1944ffa None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:58.571103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc03134-cf5d-4e9e-9562-9e71baa3b8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:58.575795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc03134-cf5d-4e9e-9562-9e71baa3b8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:58.577452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc03134-cf5d-4e9e-9562-9e71baa3b8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:58.578065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc03134-cf5d-4e9e-9562-9e71baa3b8cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:58.579304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc03134-cf5d-4e9e-9562-9e71baa3b8cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:09:58.579798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc03134-cf5d-4e9e-9562-9e71baa3b8cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:58.582446 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc03134-cf5d-4e9e-9562-9e71baa3b8cb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:58.604617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 842/1670] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:09:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:09:58.609770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecd8ab-d86c-4085-91ae-bca9f7727359 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:58.632659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eecd8ab-d86c-4085-91ae-bca9f7727359 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:58.643752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7201e0a-b7d7-4add-82f1-de0f8b74f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:58.646566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7201e0a-b7d7-4add-82f1-de0f8b74f739 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:58.647128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7201e0a-b7d7-4add-82f1-de0f8b74f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:58.647544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7201e0a-b7d7-4add-82f1-de0f8b74f739 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:58.648433 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7201e0a-b7d7-4add-82f1-de0f8b74f739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:58.657148 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7201e0a-b7d7-4add-82f1-de0f8b74f739 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:58.781211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 829/1671] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:09:58 2022] POST /identity/v3/projects => generated 371 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:09:58.786550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc03134-cf5d-4e9e-9562-9e71baa3b8cb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:58.804054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc03134-cf5d-4e9e-9562-9e71baa3b8cb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:58.913380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe79a2-cf86-4753-b00a-1d71a049c492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:58.914584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe79a2-cf86-4753-b00a-1d71a049c492 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:58.914932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe79a2-cf86-4753-b00a-1d71a049c492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:58.915373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe79a2-cf86-4753-b00a-1d71a049c492 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:58.916410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe79a2-cf86-4753-b00a-1d71a049c492 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:58.918695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fe79a2-cf86-4753-b00a-1d71a049c492 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:58.956042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:58.996865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf58d-951a-4924-a3ee-249f279ded4d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:58.997219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf58d-951a-4924-a3ee-249f279ded4d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:58.997464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eaf58d-951a-4924-a3ee-249f279ded4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:59.051243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-09eaf58d-951a-4924-a3ee-249f279ded4d None None] MFA Rules not processed for user `8cbac3c664d944788b05516600b7df25`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:59.053092 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-09eaf58d-951a-4924-a3ee-249f279ded4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:59.057206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 843/1672] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:09:58 2022] POST /identity/v3/users => generated 286 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:09:59.060526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe79a2-cf86-4753-b00a-1d71a049c492 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:59.085555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe79a2-cf86-4753-b00a-1d71a049c492 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:59.095993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc3932-757e-4780-bfd2-836e35395e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:59.096662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc3932-757e-4780-bfd2-836e35395e24 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:59.096947 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc3932-757e-4780-bfd2-836e35395e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:59.097220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc3932-757e-4780-bfd2-836e35395e24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:59.098243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc3932-757e-4780-bfd2-836e35395e24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:59.099879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc3932-757e-4780-bfd2-836e35395e24 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:59.129557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 844/1673] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:09:59.133662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc3932-757e-4780-bfd2-836e35395e24 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:59.152052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc3932-757e-4780-bfd2-836e35395e24 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:59.162120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392318f-16d6-4ce9-a535-41d3acd4c4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:59.163076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392318f-16d6-4ce9-a535-41d3acd4c4e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:59.163532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392318f-16d6-4ce9-a535-41d3acd4c4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:59.163973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e392318f-16d6-4ce9-a535-41d3acd4c4e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:59.172004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392318f-16d6-4ce9-a535-41d3acd4c4e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:59.174085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e392318f-16d6-4ce9-a535-41d3acd4c4e1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:59.189897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 830/1674] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:59.199553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 845/1675] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:09:59.204593 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaf58d-951a-4924-a3ee-249f279ded4d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:59.206161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392318f-16d6-4ce9-a535-41d3acd4c4e1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:59.214627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e392318f-16d6-4ce9-a535-41d3acd4c4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:59.228223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eaf58d-951a-4924-a3ee-249f279ded4d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:59.239109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a74158-204d-47b3-be24-ed2432f5fbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:59.241326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74158-204d-47b3-be24-ed2432f5fbba admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:59.241615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74158-204d-47b3-be24-ed2432f5fbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:59.247354 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a74158-204d-47b3-be24-ed2432f5fbba admin admin] PATH_INFO: `/v3/projects/d05f188a8ee04858b974b7d945af3604/users/f404fd1c6cc74b93b64d52ae1bb67e21/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:59.282081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a74158-204d-47b3-be24-ed2432f5fbba admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05f188a8ee04858b974b7d945af3604, user_id=f404fd1c6cc74b93b64d52ae1bb67e21, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:59.282081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a74158-204d-47b3-be24-ed2432f5fbba admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:59.348436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e392318f-16d6-4ce9-a535-41d3acd4c4e1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:59.355706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533e004-b1a3-4214-a7af-07d638192f89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:59.356551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533e004-b1a3-4214-a7af-07d638192f89 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:59.356929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533e004-b1a3-4214-a7af-07d638192f89 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:59.366446 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533e004-b1a3-4214-a7af-07d638192f89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:59.368270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533e004-b1a3-4214-a7af-07d638192f89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:59.370116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533e004-b1a3-4214-a7af-07d638192f89 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:59.404188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 831/1676] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:09:59 2022] PUT /identity/v3/projects/d05f188a8ee04858b974b7d945af3604/users/f404fd1c6cc74b93b64d52ae1bb67e21/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:09:59.406632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 846/1677] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:09:59.408239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bbd06-ec10-42be-9809-127c909c5842 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:59.408664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bbd06-ec10-42be-9809-127c909c5842 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:59.409120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864bbd06-ec10-42be-9809-127c909c5842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:59.457138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-864bbd06-ec10-42be-9809-127c909c5842 None None] MFA Rules not processed for user `f404fd1c6cc74b93b64d52ae1bb67e21`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:09:59.458692 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-864bbd06-ec10-42be-9809-127c909c5842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:59.560492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 832/1678] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:09:59 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:09:59.573734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533e004-b1a3-4214-a7af-07d638192f89 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:59.576227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f533e004-b1a3-4214-a7af-07d638192f89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:59.602895 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:09:59.619265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533e004-b1a3-4214-a7af-07d638192f89 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:59.663372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bbd06-ec10-42be-9809-127c909c5842 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:09:59.664964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-864bbd06-ec10-42be-9809-127c909c5842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:09:59.880426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c5aed1-8969-48f8-8d0c-cc8b00f167a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:59.880426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5aed1-8969-48f8-8d0c-cc8b00f167a6 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:59.883253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5aed1-8969-48f8-8d0c-cc8b00f167a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:59.883253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c5aed1-8969-48f8-8d0c-cc8b00f167a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:59.893161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864bbd06-ec10-42be-9809-127c909c5842 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:09:59.903980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5aed1-8969-48f8-8d0c-cc8b00f167a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:59.906854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:09:59.908373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:09:59.908373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:09:59.908373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] PATH_INFO: `/v3/projects/afe914fbaa994f5c831b5262edece089` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:09:59.909366 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c5aed1-8969-48f8-8d0c-cc8b00f167a6 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:59.912658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=afe914fbaa994f5c831b5262edece089)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:09:59.915495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 20 22:09:59.915495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: warnings.warn(msg) Jul 20 22:09:59.915495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: Jul 20 22:09:59.915495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:09:59.945211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 847/1679] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:09:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:00.104715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe914fbaa994f5c831b5262edece089', 'request_id': 'req-477494b7-265d-4e1d-9b01-196e38b1ef3c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:00.113235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe914fbaa994f5c831b5262edece089', 'request_id': 'req-477494b7-265d-4e1d-9b01-196e38b1ef3c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:00.196758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe914fbaa994f5c831b5262edece089', 'request_id': 'req-477494b7-265d-4e1d-9b01-196e38b1ef3c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:00.250671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] The token cache is being invalidate because project afe914fbaa994f5c831b5262edece089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:00.250969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:00.251979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-477494b7-265d-4e1d-9b01-196e38b1ef3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:00.253995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 833/1680] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:09:59 2022] DELETE /identity/v3/projects/afe914fbaa994f5c831b5262edece089 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:00.258886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20727b80-262c-469a-9595-3d76583dad8b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:00.259402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20727b80-262c-469a-9595-3d76583dad8b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:00.259483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20727b80-262c-469a-9595-3d76583dad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:00.291299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-20727b80-262c-469a-9595-3d76583dad8b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:00.293448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-20727b80-262c-469a-9595-3d76583dad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:00.437352 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 848/1681] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:00.444887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf33ccc-dd87-4bb7-89ce-fe3d70ed6281 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:00.445454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf33ccc-dd87-4bb7-89ce-fe3d70ed6281 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:00.445454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf33ccc-dd87-4bb7-89ce-fe3d70ed6281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:00.481659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3cf33ccc-dd87-4bb7-89ce-fe3d70ed6281 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:00.482907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3cf33ccc-dd87-4bb7-89ce-fe3d70ed6281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:00.503245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 834/1682] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:00.507206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20727b80-262c-469a-9595-3d76583dad8b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:00.530644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20727b80-262c-469a-9595-3d76583dad8b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:00.536861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef9f61-5d3b-474f-96cb-87118fd0e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:00.537905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef9f61-5d3b-474f-96cb-87118fd0e8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:00.538546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef9f61-5d3b-474f-96cb-87118fd0e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:00.539123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ef9f61-5d3b-474f-96cb-87118fd0e8a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:00.540070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef9f61-5d3b-474f-96cb-87118fd0e8a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:00.557704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef9f61-5d3b-474f-96cb-87118fd0e8a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:00.557704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ef9f61-5d3b-474f-96cb-87118fd0e8a4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:00.569079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 849/1683] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:00.572958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf33ccc-dd87-4bb7-89ce-fe3d70ed6281 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:00.586562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf33ccc-dd87-4bb7-89ce-fe3d70ed6281 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:00.601423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f812237-4460-4e22-a65e-55fc02cead0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:00.602344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f812237-4460-4e22-a65e-55fc02cead0d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:00.602799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f812237-4460-4e22-a65e-55fc02cead0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:00.603252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f812237-4460-4e22-a65e-55fc02cead0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:00.604166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f812237-4460-4e22-a65e-55fc02cead0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:00.606256 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f812237-4460-4e22-a65e-55fc02cead0d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:00.713505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 835/1684] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:00 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:00.718746 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef9f61-5d3b-474f-96cb-87118fd0e8a4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:00.735138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ef9f61-5d3b-474f-96cb-87118fd0e8a4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:00.866732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111b802-dfc9-4b23-b744-d0661f2b77cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:00.872068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111b802-dfc9-4b23-b744-d0661f2b77cb admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:00.872068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111b802-dfc9-4b23-b744-d0661f2b77cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:00.872068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e111b802-dfc9-4b23-b744-d0661f2b77cb admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:00.872068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111b802-dfc9-4b23-b744-d0661f2b77cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:00.872068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e111b802-dfc9-4b23-b744-d0661f2b77cb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:00.976797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 850/1685] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:00 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:00.981128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f812237-4460-4e22-a65e-55fc02cead0d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:00.997367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f812237-4460-4e22-a65e-55fc02cead0d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:01.013955 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4f532-b8cb-432b-8b94-15bbab223b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:01.016334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4f532-b8cb-432b-8b94-15bbab223b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:01.016940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4f532-b8cb-432b-8b94-15bbab223b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:01.017892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4f532-b8cb-432b-8b94-15bbab223b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:01.019036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4f532-b8cb-432b-8b94-15bbab223b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:01.024961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d4f532-b8cb-432b-8b94-15bbab223b75 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:01.061037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 836/1686] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:01.067218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111b802-dfc9-4b23-b744-d0661f2b77cb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:01.079397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e111b802-dfc9-4b23-b744-d0661f2b77cb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:01.094044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aeada-8676-4d30-bead-69faf251b1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:01.097687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aeada-8676-4d30-bead-69faf251b1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:01.098814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aeada-8676-4d30-bead-69faf251b1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:01.099550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aeada-8676-4d30-bead-69faf251b1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:01.100535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aeada-8676-4d30-bead-69faf251b1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:01.105414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aeada-8676-4d30-bead-69faf251b1e8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:01.142538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 851/1687] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:01.143734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4f532-b8cb-432b-8b94-15bbab223b75 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:01.161219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4f532-b8cb-432b-8b94-15bbab223b75 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:01.173473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69c894-c2e9-4ceb-9a5c-791cb58c1936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:01.175820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c894-c2e9-4ceb-9a5c-791cb58c1936 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:01.176262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c894-c2e9-4ceb-9a5c-791cb58c1936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:01.177574 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69c894-c2e9-4ceb-9a5c-791cb58c1936 admin admin] PATH_INFO: `/v3/projects/10d85f059477452ca979d610bd83725e/users/06715a212a2d4c028a214f742a9b4bb5/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:01.207383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:01.230972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69c894-c2e9-4ceb-9a5c-791cb58c1936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d85f059477452ca979d610bd83725e, user_id=06715a212a2d4c028a214f742a9b4bb5, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:01.236907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69c894-c2e9-4ceb-9a5c-791cb58c1936 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:01.238837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aeada-8676-4d30-bead-69faf251b1e8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:01.240990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4f0aeada-8676-4d30-bead-69faf251b1e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:01.278559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aeada-8676-4d30-bead-69faf251b1e8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:01.292564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:01.294013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:01.294503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:01.295090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] PATH_INFO: `/v3/users/f602a2bdf3e1437faacfeeccb1b75d83` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:01.300797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f602a2bdf3e1437faacfeeccb1b75d83)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:01.303639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:01.355954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 837/1688] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:01 2022] PUT /identity/v3/projects/10d85f059477452ca979d610bd83725e/users/06715a212a2d4c028a214f742a9b4bb5/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:01.367099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326dacb-9e79-460c-b88f-e4a7fc85606c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:01.367099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326dacb-9e79-460c-b88f-e4a7fc85606c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:01.367282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f326dacb-9e79-460c-b88f-e4a7fc85606c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:01.501436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f326dacb-9e79-460c-b88f-e4a7fc85606c None None] MFA Rules not processed for user `06715a212a2d4c028a214f742a9b4bb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:01.508229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f326dacb-9e79-460c-b88f-e4a7fc85606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:01.652905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f602a2bdf3e1437faacfeeccb1b75d83'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:01.745574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f602a2bdf3e1437faacfeeccb1b75d83'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:01.762276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f602a2bdf3e1437faacfeeccb1b75d83'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:01.764341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f602a2bdf3e1437faacfeeccb1b75d83'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:01.802046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 838/1689] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 435 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:01.802949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326dacb-9e79-460c-b88f-e4a7fc85606c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:01.806467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f326dacb-9e79-460c-b88f-e4a7fc85606c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:01.823309 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f602a2bdf3e1437faacfeeccb1b75d83'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:01.847217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 852/1690] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:01 2022] DELETE /identity/v3/users/f602a2bdf3e1437faacfeeccb1b75d83 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:01.848232 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:01.852848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:01.889482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:02.166691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe3abb-fcbc-436b-a102-506ea3a6dda1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:02.167400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f326dacb-9e79-460c-b88f-e4a7fc85606c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:02.167670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2660914d-1bc3-4e8e-a293-7016effcdcd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:02.167670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660914d-1bc3-4e8e-a293-7016effcdcd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:02.167670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660914d-1bc3-4e8e-a293-7016effcdcd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:02.167670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2660914d-1bc3-4e8e-a293-7016effcdcd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:02.168609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660914d-1bc3-4e8e-a293-7016effcdcd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:02.168609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2660914d-1bc3-4e8e-a293-7016effcdcd1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:02.168742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:02.168742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:02.168742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:02.168742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] PATH_INFO: `/v3/users/996d28f48fd44a24b8f265eef0143add` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:02.169000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] RBAC: Authorizing `identity:delete_user(user_id=996d28f48fd44a24b8f265eef0143add)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:02.169000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:02.320592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 853/1691] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:01 2022] POST /identity/v3/projects => generated 387 bytes in 473 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:02.323490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abb296-b999-4d58-9b14-d0aa80155590 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:02.324015 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abb296-b999-4d58-9b14-d0aa80155590 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:02.324446 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abb296-b999-4d58-9b14-d0aa80155590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:02.421857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-76abb296-b999-4d58-9b14-d0aa80155590 None None] MFA Rules not processed for user `66801c15461d4b419949b4959805306a`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:02.424241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-76abb296-b999-4d58-9b14-d0aa80155590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:02.461694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '996d28f48fd44a24b8f265eef0143add'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:02.493424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '996d28f48fd44a24b8f265eef0143add'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:02.517031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '996d28f48fd44a24b8f265eef0143add'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:02.518477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '996d28f48fd44a24b8f265eef0143add'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:02.520297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '996d28f48fd44a24b8f265eef0143add'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:02.618942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 839/1692] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:01 2022] DELETE /identity/v3/users/996d28f48fd44a24b8f265eef0143add => generated 0 bytes in 816 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:02.619641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:02.625613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:02.678374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 854/1693] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:02.680851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889328-4338-43b9-bebb-24f27b3d8faa None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:02.683346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889328-4338-43b9-bebb-24f27b3d8faa None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:02.683805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4889328-4338-43b9-bebb-24f27b3d8faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:02.753152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f4889328-4338-43b9-bebb-24f27b3d8faa None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:02.755833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f4889328-4338-43b9-bebb-24f27b3d8faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:02.820952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760061d5-9b69-4891-a70e-338c883a0329 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:02.837616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f66d2e-1843-4015-bbe9-7a3cc3a44d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:02.842474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f66d2e-1843-4015-bbe9-7a3cc3a44d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:02.842773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f66d2e-1843-4015-bbe9-7a3cc3a44d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:02.843620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f66d2e-1843-4015-bbe9-7a3cc3a44d30 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:02.850169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f66d2e-1843-4015-bbe9-7a3cc3a44d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:02.870641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f66d2e-1843-4015-bbe9-7a3cc3a44d30 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:02.954399 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 855/1694] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:02.956192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107afc-57c0-4b2c-b34e-b58c33f857f8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:02.956691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107afc-57c0-4b2c-b34e-b58c33f857f8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:02.957121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb107afc-57c0-4b2c-b34e-b58c33f857f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:02.990379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bb107afc-57c0-4b2c-b34e-b58c33f857f8 None None] MFA Rules not processed for user `66801c15461d4b419949b4959805306a`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:02.992133 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bb107afc-57c0-4b2c-b34e-b58c33f857f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:03.058201 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 840/1695] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:02 2022] POST /identity/v3/users => generated 300 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:03.059563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f66d2e-1843-4015-bbe9-7a3cc3a44d30 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:03.069464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c5f66d2e-1843-4015-bbe9-7a3cc3a44d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:03.102252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f66d2e-1843-4015-bbe9-7a3cc3a44d30 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:03.117965 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:03.126659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:03.127027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:03.128646 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] PATH_INFO: `/v3/projects/bedc671041b24539b337fc0485b9eca4` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:03.132784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bedc671041b24539b337fc0485b9eca4)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:03.137868 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:03.200806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 856/1696] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:03.203448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb107afc-57c0-4b2c-b34e-b58c33f857f8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:03.220753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bb107afc-57c0-4b2c-b34e-b58c33f857f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:03.373840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb107afc-57c0-4b2c-b34e-b58c33f857f8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:03.382037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5ec5d-c3bb-4ead-a3e6-43f533e98265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:03.382748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5ec5d-c3bb-4ead-a3e6-43f533e98265 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:03.383030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5ec5d-c3bb-4ead-a3e6-43f533e98265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:03.383311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5ec5d-c3bb-4ead-a3e6-43f533e98265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:03.413896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5ec5d-c3bb-4ead-a3e6-43f533e98265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:03.413896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5ec5d-c3bb-4ead-a3e6-43f533e98265 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:03.439840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 857/1697] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:03.449075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5ec5d-c3bb-4ead-a3e6-43f533e98265 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:03.491644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5ec5d-c3bb-4ead-a3e6-43f533e98265 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:03.492286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bedc671041b24539b337fc0485b9eca4', 'request_id': 'req-3cd982bb-8d2e-440c-97ff-ba6630994d92'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:03.496346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:03.508300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bedc671041b24539b337fc0485b9eca4', 'request_id': 'req-3cd982bb-8d2e-440c-97ff-ba6630994d92'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:03.650150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bedc671041b24539b337fc0485b9eca4', 'request_id': 'req-3cd982bb-8d2e-440c-97ff-ba6630994d92'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:03.670618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d198e89-85b6-4327-b494-1e4411419c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:03.672740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d198e89-85b6-4327-b494-1e4411419c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:03.673032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d198e89-85b6-4327-b494-1e4411419c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:03.673303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d198e89-85b6-4327-b494-1e4411419c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:03.674375 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d198e89-85b6-4327-b494-1e4411419c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:03.676657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] The token cache is being invalidate because project bedc671041b24539b337fc0485b9eca4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:03.677555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:03.679884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:03.680064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d198e89-85b6-4327-b494-1e4411419c98 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:03.689956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 841/1698] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:03 2022] DELETE /identity/v3/projects/bedc671041b24539b337fc0485b9eca4 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:03.691901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:03.696731 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:03.703601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 858/1699] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:03.703601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d198e89-85b6-4327-b494-1e4411419c98 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:03.704461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0d198e89-85b6-4327-b494-1e4411419c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:03.741855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d198e89-85b6-4327-b494-1e4411419c98 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:03.748335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:03.749798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:03.750082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:03.750552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] PATH_INFO: `/v3/users/9773d26fbd584415b0d79dc51cf069a8` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:03.752338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9773d26fbd584415b0d79dc51cf069a8)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:03.798433 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:03.926562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd982bb-8d2e-440c-97ff-ba6630994d92 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:03.944873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb221b9a-4da3-4bd2-9bfb-323097730645 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:03.945777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb221b9a-4da3-4bd2-9bfb-323097730645 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:03.946238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb221b9a-4da3-4bd2-9bfb-323097730645 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:03.947006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb221b9a-4da3-4bd2-9bfb-323097730645 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:03.953197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb221b9a-4da3-4bd2-9bfb-323097730645 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:04.087692 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb221b9a-4da3-4bd2-9bfb-323097730645 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:04.092480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb221b9a-4da3-4bd2-9bfb-323097730645 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:04.103371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 842/1700] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:04.104617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb221b9a-4da3-4bd2-9bfb-323097730645 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:04.106891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb221b9a-4da3-4bd2-9bfb-323097730645 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:04.124454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9773d26fbd584415b0d79dc51cf069a8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:04.177747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb221b9a-4da3-4bd2-9bfb-323097730645 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:04.197874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cedb3-0733-4ff6-b125-be44b6d73e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:04.199324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cedb3-0733-4ff6-b125-be44b6d73e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:04.199853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cedb3-0733-4ff6-b125-be44b6d73e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:04.200362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cedb3-0733-4ff6-b125-be44b6d73e75 admin admin] PATH_INFO: `/v3/projects/0021f19841974a2ba16e77369193b11f/users/7659ef1e6cda45dc822c19dc8192188f/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:04.229842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9773d26fbd584415b0d79dc51cf069a8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:04.241040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9773d26fbd584415b0d79dc51cf069a8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:04.242026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9773d26fbd584415b0d79dc51cf069a8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:04.244609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cedb3-0733-4ff6-b125-be44b6d73e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0021f19841974a2ba16e77369193b11f, user_id=7659ef1e6cda45dc822c19dc8192188f, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:04.247437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cedb3-0733-4ff6-b125-be44b6d73e75 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:04.275679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ad6258e7-9e01-4d57-95ff-db4cfa16ae8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9773d26fbd584415b0d79dc51cf069a8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:04.292273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 859/1701] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:03 2022] DELETE /identity/v3/users/9773d26fbd584415b0d79dc51cf069a8 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:04.369091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46770947-8183-40b4-bcb3-b0428ff016c1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:04.369389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46770947-8183-40b4-bcb3-b0428ff016c1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:04.369684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46770947-8183-40b4-bcb3-b0428ff016c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:04.372325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 843/1702] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:04 2022] PUT /identity/v3/projects/0021f19841974a2ba16e77369193b11f/users/7659ef1e6cda45dc822c19dc8192188f/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:04.376400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cedb3-0733-4ff6-b125-be44b6d73e75 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:04.379378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3b8cedb3-0733-4ff6-b125-be44b6d73e75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:04.427281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-46770947-8183-40b4-bcb3-b0428ff016c1 None None] MFA Rules not processed for user `c1c4f2a6178140858efd4599a3f975d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:04.427964 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-46770947-8183-40b4-bcb3-b0428ff016c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:04.453974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:04.549780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cedb3-0733-4ff6-b125-be44b6d73e75 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:04.564504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c154a7-8d73-4e8f-9a2b-35d1a3facadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:04.566096 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 860/1703] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:04.585568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c154a7-8d73-4e8f-9a2b-35d1a3facadb admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:04.585568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c154a7-8d73-4e8f-9a2b-35d1a3facadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:04.585568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c154a7-8d73-4e8f-9a2b-35d1a3facadb admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:04.591175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c154a7-8d73-4e8f-9a2b-35d1a3facadb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:04.599235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c154a7-8d73-4e8f-9a2b-35d1a3facadb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:04.636901 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46770947-8183-40b4-bcb3-b0428ff016c1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:04.639510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-46770947-8183-40b4-bcb3-b0428ff016c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:04.648769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 844/1704] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:04 2022] GET /identity/v3/roles => generated 1420 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:10:04.648769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c154a7-8d73-4e8f-9a2b-35d1a3facadb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:04.650300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-34c154a7-8d73-4e8f-9a2b-35d1a3facadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:04.662422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46770947-8183-40b4-bcb3-b0428ff016c1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:04.669256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:04.670207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:04.670487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:04.672811 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] PATH_INFO: `/v3/users/f404fd1c6cc74b93b64d52ae1bb67e21` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:04.677292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f404fd1c6cc74b93b64d52ae1bb67e21)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:04.677412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:04.820730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c154a7-8d73-4e8f-9a2b-35d1a3facadb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:04.832389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35f55-d651-4f5d-b772-84562db1d5f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:04.834802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35f55-d651-4f5d-b772-84562db1d5f4 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:04.835962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35f55-d651-4f5d-b772-84562db1d5f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:04.836482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b35f55-d651-4f5d-b772-84562db1d5f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:04.849328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35f55-d651-4f5d-b772-84562db1d5f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:04.852802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b35f55-d651-4f5d-b772-84562db1d5f4 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:04.881542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 845/1705] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:04.882672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35f55-d651-4f5d-b772-84562db1d5f4 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:04.910283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b35f55-d651-4f5d-b772-84562db1d5f4 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:04.911722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f404fd1c6cc74b93b64d52ae1bb67e21'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:04.921342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d514a8-dec5-42ed-8955-fd7204553753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:04.922305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d514a8-dec5-42ed-8955-fd7204553753 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:04.922585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d514a8-dec5-42ed-8955-fd7204553753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:04.922910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d514a8-dec5-42ed-8955-fd7204553753 admin admin] PATH_INFO: `/v3/projects/0021f19841974a2ba16e77369193b11f/users/7659ef1e6cda45dc822c19dc8192188f/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:04.926251 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d514a8-dec5-42ed-8955-fd7204553753 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0021f19841974a2ba16e77369193b11f, user_id=7659ef1e6cda45dc822c19dc8192188f, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:04.929444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d514a8-dec5-42ed-8955-fd7204553753 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:04.945222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 846/1706] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:04 2022] PUT /identity/v3/projects/0021f19841974a2ba16e77369193b11f/users/7659ef1e6cda45dc822c19dc8192188f/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:04.956658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a9ca2-4a10-41a3-9779-cfd6e2ff468a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:04.956948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a9ca2-4a10-41a3-9779-cfd6e2ff468a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:04.957816 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a9ca2-4a10-41a3-9779-cfd6e2ff468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:04.989455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f404fd1c6cc74b93b64d52ae1bb67e21'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:04.993496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:05.003407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f404fd1c6cc74b93b64d52ae1bb67e21'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:05.005603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f404fd1c6cc74b93b64d52ae1bb67e21'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:05.014613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f54a9ca2-4a10-41a3-9779-cfd6e2ff468a None None] MFA Rules not processed for user `7659ef1e6cda45dc822c19dc8192188f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:05.016627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f54a9ca2-4a10-41a3-9779-cfd6e2ff468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:05.045666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-89a66083-9c1c-45d8-a622-67a0fed74af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f404fd1c6cc74b93b64d52ae1bb67e21'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:05.073204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 861/1707] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:04 2022] DELETE /identity/v3/users/f404fd1c6cc74b93b64d52ae1bb67e21 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:05.081203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1640a-2263-4c42-b85a-0bf955818f2c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:05.085330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1640a-2263-4c42-b85a-0bf955818f2c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:05.085330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1640a-2263-4c42-b85a-0bf955818f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:05.104663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-dfa1640a-2263-4c42-b85a-0bf955818f2c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:05.106532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dfa1640a-2263-4c42-b85a-0bf955818f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:05.196235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 847/1708] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:04 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:05.196235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a9ca2-4a10-41a3-9779-cfd6e2ff468a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:05.196235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f54a9ca2-4a10-41a3-9779-cfd6e2ff468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:05.252965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 862/1709] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:05.255183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1640a-2263-4c42-b85a-0bf955818f2c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:05.257121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dfa1640a-2263-4c42-b85a-0bf955818f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:05.386087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a9ca2-4a10-41a3-9779-cfd6e2ff468a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:05.410911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:05.411800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:05.412376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:05.412843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] PATH_INFO: `/v3/projects/bcd64cf0c8394013b24ae23fa2e4640e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:05.421579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcd64cf0c8394013b24ae23fa2e4640e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:05.434541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:05.449152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1640a-2263-4c42-b85a-0bf955818f2c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:05.458648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88498e1b-00d7-434c-bb64-5748c4b9cb00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:05.460486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88498e1b-00d7-434c-bb64-5748c4b9cb00 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:05.460486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88498e1b-00d7-434c-bb64-5748c4b9cb00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:05.461125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88498e1b-00d7-434c-bb64-5748c4b9cb00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:05.643643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcd64cf0c8394013b24ae23fa2e4640e', 'request_id': 'req-ffa79d29-e17c-4191-973d-ae4c94e15752'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:05.657704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88498e1b-00d7-434c-bb64-5748c4b9cb00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:05.661007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcd64cf0c8394013b24ae23fa2e4640e', 'request_id': 'req-ffa79d29-e17c-4191-973d-ae4c94e15752'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:05.662878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88498e1b-00d7-434c-bb64-5748c4b9cb00 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:05.688631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 863/1710] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:05 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:05.706689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb41c21-3e22-4ab5-801e-cc45f4932360 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:05.709058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb41c21-3e22-4ab5-801e-cc45f4932360 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:05.711553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb41c21-3e22-4ab5-801e-cc45f4932360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:05.747584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4fb41c21-3e22-4ab5-801e-cc45f4932360 None None] MFA Rules not processed for user `8cbac3c664d944788b05516600b7df25`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:05.748990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4fb41c21-3e22-4ab5-801e-cc45f4932360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:05.756167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcd64cf0c8394013b24ae23fa2e4640e', 'request_id': 'req-ffa79d29-e17c-4191-973d-ae4c94e15752'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:05.784346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] The token cache is being invalidate because project bcd64cf0c8394013b24ae23fa2e4640e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:05.785124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:05.786938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:05.806598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 848/1711] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:05 2022] DELETE /identity/v3/projects/bcd64cf0c8394013b24ae23fa2e4640e => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:05.807398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:05.819555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:05.845426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 864/1712] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:05.854855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cfa9a-0f00-4602-81bf-c032526fd21a None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:05.855201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cfa9a-0f00-4602-81bf-c032526fd21a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:05.855482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8cfa9a-0f00-4602-81bf-c032526fd21a None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:05.858528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 865/1713] 10.222.0.85 () {54 vars in 912 bytes} [Wed Jul 20 22:10:05 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:10:05.861221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cfa9a-0f00-4602-81bf-c032526fd21a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:05.861909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cc8cfa9a-0f00-4602-81bf-c032526fd21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:05.985662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa79d29-e17c-4191-973d-ae4c94e15752 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:05.990697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391447a-362d-493c-a4ef-9e78cac26a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:05.991748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391447a-362d-493c-a4ef-9e78cac26a31 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:05.992069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391447a-362d-493c-a4ef-9e78cac26a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:05.996090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391447a-362d-493c-a4ef-9e78cac26a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:05.996090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1391447a-362d-493c-a4ef-9e78cac26a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:06.029646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8cfa9a-0f00-4602-81bf-c032526fd21a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:06.036443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:06.036443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:06.037015 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:06.037444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] PATH_INFO: `/v3/projects/659dfa7be64142adaca0371da26a7830` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:06.039346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] RBAC: Authorizing `identity:delete_project(project_id=659dfa7be64142adaca0371da26a7830)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:06.042603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:06.087020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:06.194518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391447a-362d-493c-a4ef-9e78cac26a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:06.198244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391447a-362d-493c-a4ef-9e78cac26a31 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:06.227863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 849/1714] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:06.231011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391447a-362d-493c-a4ef-9e78cac26a31 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:06.231011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1391447a-362d-493c-a4ef-9e78cac26a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:06.233287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '659dfa7be64142adaca0371da26a7830', 'request_id': 'req-6ffe07d3-3ca9-4b59-9d60-231c39785733'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:06.240260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '659dfa7be64142adaca0371da26a7830', 'request_id': 'req-6ffe07d3-3ca9-4b59-9d60-231c39785733'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:06.247515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391447a-362d-493c-a4ef-9e78cac26a31 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:06.333070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '659dfa7be64142adaca0371da26a7830', 'request_id': 'req-6ffe07d3-3ca9-4b59-9d60-231c39785733'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:06.363849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] The token cache is being invalidate because project 659dfa7be64142adaca0371da26a7830 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:06.364182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:06.366028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6ffe07d3-3ca9-4b59-9d60-231c39785733 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:06.376443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 866/1715] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:05 2022] DELETE /identity/v3/projects/659dfa7be64142adaca0371da26a7830 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:06.378284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadab6e-13d3-471a-9679-04962c11bb03 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:06.378588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadab6e-13d3-471a-9679-04962c11bb03 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:06.378867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadab6e-13d3-471a-9679-04962c11bb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:06.380993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:06.385459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:06.385459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:06.385459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] PATH_INFO: `/v3/users/06715a212a2d4c028a214f742a9b4bb5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:06.385459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06715a212a2d4c028a214f742a9b4bb5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:06.388874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:06.419842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1fadab6e-13d3-471a-9679-04962c11bb03 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:06.424105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1fadab6e-13d3-471a-9679-04962c11bb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:06.444619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 867/1716] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:06.446312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064dbee-b773-4e02-bcd4-1a72491d88f7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:06.446668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064dbee-b773-4e02-bcd4-1a72491d88f7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:06.446951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8064dbee-b773-4e02-bcd4-1a72491d88f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:06.557698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-8064dbee-b773-4e02-bcd4-1a72491d88f7 None None] MFA Rules not processed for user `2ad07969d5a043e7b83e403da35120da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:06.561832 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8064dbee-b773-4e02-bcd4-1a72491d88f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:06.690692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 868/1717] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:10:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:06.690692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9abe-036c-4ca8-b364-45c1705dfc47 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:06.690934 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9abe-036c-4ca8-b364-45c1705dfc47 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:06.692312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca9abe-036c-4ca8-b364-45c1705dfc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:06.695822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:06.708628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06715a212a2d4c028a214f742a9b4bb5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:06.745989 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06715a212a2d4c028a214f742a9b4bb5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:06.755116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d8ca9abe-036c-4ca8-b364-45c1705dfc47 None None] MFA Rules not processed for user `9dbbfc0772104ed6af5c8cf8d406f64b`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:06.756713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d8ca9abe-036c-4ca8-b364-45c1705dfc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:06.765601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06715a212a2d4c028a214f742a9b4bb5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:06.765919 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06715a212a2d4c028a214f742a9b4bb5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:06.769336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06715a212a2d4c028a214f742a9b4bb5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:06.852402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 850/1718] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:06 2022] DELETE /identity/v3/users/06715a212a2d4c028a214f742a9b4bb5 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:06.852402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:06.858416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:06.908285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 869/1719] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:06.921547 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a37743-3fe4-4ac8-bf1b-3e12f304c0e7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:06.921547 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a37743-3fe4-4ac8-bf1b-3e12f304c0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:06.921547 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a37743-3fe4-4ac8-bf1b-3e12f304c0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:06.951361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b9a37743-3fe4-4ac8-bf1b-3e12f304c0e7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:06.965401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b9a37743-3fe4-4ac8-bf1b-3e12f304c0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:07.039200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc808fb3-d650-49ef-aafb-cec954f94005 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:07.059957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:07.060382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:07.060666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:07.060939 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] PATH_INFO: `/v3/users/d5fb90ef49624843894108cecad3822f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:07.064992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5fb90ef49624843894108cecad3822f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:07.068017 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:07.143519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 870/1720] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:07.156339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a37743-3fe4-4ac8-bf1b-3e12f304c0e7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:07.156339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:07.156339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b9a37743-3fe4-4ac8-bf1b-3e12f304c0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:07.278345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a37743-3fe4-4ac8-bf1b-3e12f304c0e7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:07.287654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951fe7e-7330-4a35-abbf-d96ce791b188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:07.288678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951fe7e-7330-4a35-abbf-d96ce791b188 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:07.289281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951fe7e-7330-4a35-abbf-d96ce791b188 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:07.289632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951fe7e-7330-4a35-abbf-d96ce791b188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:07.292778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f951fe7e-7330-4a35-abbf-d96ce791b188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:07.318975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951fe7e-7330-4a35-abbf-d96ce791b188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:07.320700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951fe7e-7330-4a35-abbf-d96ce791b188 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:07.325912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5fb90ef49624843894108cecad3822f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:07.339360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 871/1721] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:07.342510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc066-0783-4898-9a2a-25942ff6d531 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:07.343510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc066-0783-4898-9a2a-25942ff6d531 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:07.344368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41dc066-0783-4898-9a2a-25942ff6d531 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:07.347684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 872/1722] 10.222.0.85 () {54 vars in 912 bytes} [Wed Jul 20 22:10:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:10:07.349527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6c08-e022-4dca-9fd5-07e85aa232bb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:07.349967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6c08-e022-4dca-9fd5-07e85aa232bb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:07.350349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dff6c08-e022-4dca-9fd5-07e85aa232bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:07.360977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5fb90ef49624843894108cecad3822f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:07.372216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5fb90ef49624843894108cecad3822f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:07.373695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5fb90ef49624843894108cecad3822f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:07.377440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5fb90ef49624843894108cecad3822f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:07.437795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5dff6c08-e022-4dca-9fd5-07e85aa232bb None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:07.439853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5dff6c08-e022-4dca-9fd5-07e85aa232bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:07.450389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 873/1723] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:07.452782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb96a-89e8-4ac3-973d-75528fb98a6a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:07.453828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb96a-89e8-4ac3-973d-75528fb98a6a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:07.454327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490cb96a-89e8-4ac3-973d-75528fb98a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:07.473115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 851/1724] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:06 2022] DELETE /identity/v3/users/d5fb90ef49624843894108cecad3822f => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:07.477490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:07.479536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:07.489139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-490cb96a-89e8-4ac3-973d-75528fb98a6a None None] MFA Rules not processed for user `9dbbfc0772104ed6af5c8cf8d406f64b`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:07.491703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-490cb96a-89e8-4ac3-973d-75528fb98a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:07.553974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:07.643606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf93485c-8931-4b43-8d24-40e9c7e50f25 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:07.647792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 874/1725] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:07.649337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e5abf-f4e1-4313-806f-8de888105b65 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:07.649536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e5abf-f4e1-4313-806f-8de888105b65 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:07.649824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e5abf-f4e1-4313-806f-8de888105b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:07.662446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc9793-164a-4271-9832-2666f512e2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:07.662446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc9793-164a-4271-9832-2666f512e2ea admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:07.662446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc9793-164a-4271-9832-2666f512e2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:07.662446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc9793-164a-4271-9832-2666f512e2ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:07.665220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc9793-164a-4271-9832-2666f512e2ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:07.667649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc9793-164a-4271-9832-2666f512e2ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:07.669733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc9793-164a-4271-9832-2666f512e2ea admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:07.684378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-dc1e5abf-f4e1-4313-806f-8de888105b65 None None] MFA Rules not processed for user `2ad07969d5a043e7b83e403da35120da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:07.688625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dc1e5abf-f4e1-4313-806f-8de888105b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:07.700126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 852/1726] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:07.705085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc9793-164a-4271-9832-2666f512e2ea admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:07.710004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eabc9793-164a-4271-9832-2666f512e2ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:07.792515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 875/1727] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:10:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:07.793190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e5abf-f4e1-4313-806f-8de888105b65 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:07.795323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dc1e5abf-f4e1-4313-806f-8de888105b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:07.814495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e5abf-f4e1-4313-806f-8de888105b65 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:07.821452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:07.821957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:07.822248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:07.822538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] PATH_INFO: `/v3/projects/d05f188a8ee04858b974b7d945af3604` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:07.823785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05f188a8ee04858b974b7d945af3604)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:07.826093 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:07.831498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc9793-164a-4271-9832-2666f512e2ea admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:07.836324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45e670-38ca-47f3-aed5-e56fc601392d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:07.837543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e670-38ca-47f3-aed5-e56fc601392d service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:07.837986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e670-38ca-47f3-aed5-e56fc601392d service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:07.838420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45e670-38ca-47f3-aed5-e56fc601392d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:07.877378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45e670-38ca-47f3-aed5-e56fc601392d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:07.879577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45e670-38ca-47f3-aed5-e56fc601392d service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:07.914844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 853/1728] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:07.915967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45e670-38ca-47f3-aed5-e56fc601392d service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:07.958498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45e670-38ca-47f3-aed5-e56fc601392d service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:07.966594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05f188a8ee04858b974b7d945af3604', 'request_id': 'req-e147140f-4aef-466c-9329-9ef1839c9286'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:07.983503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05f188a8ee04858b974b7d945af3604', 'request_id': 'req-e147140f-4aef-466c-9329-9ef1839c9286'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:08.211186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f7a45a-799a-4e28-9f41-6a7f16db19ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:08.211893 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a45a-799a-4e28-9f41-6a7f16db19ff admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:08.212204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a45a-799a-4e28-9f41-6a7f16db19ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:08.212484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f7a45a-799a-4e28-9f41-6a7f16db19ff admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:08.213631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7a45a-799a-4e28-9f41-6a7f16db19ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:08.215739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f7a45a-799a-4e28-9f41-6a7f16db19ff admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:08.229989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05f188a8ee04858b974b7d945af3604', 'request_id': 'req-e147140f-4aef-466c-9329-9ef1839c9286'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:08.253179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] The token cache is being invalidate because project d05f188a8ee04858b974b7d945af3604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:08.254436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:08.255793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:08.266283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 876/1729] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:07 2022] DELETE /identity/v3/projects/d05f188a8ee04858b974b7d945af3604 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:08.267672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:08.272646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:08.361328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 854/1730] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:07 2022] POST /identity/v3/projects => generated 357 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:08.362703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc937-29ce-4ba2-8b24-c66cbc737cf8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:08.363009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc937-29ce-4ba2-8b24-c66cbc737cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:08.363285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dc937-29ce-4ba2-8b24-c66cbc737cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:08.413631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-955dc937-29ce-4ba2-8b24-c66cbc737cf8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:08.417956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-955dc937-29ce-4ba2-8b24-c66cbc737cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:08.500948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e147140f-4aef-466c-9329-9ef1839c9286 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:08.622314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 855/1731] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:08.622314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dc937-29ce-4ba2-8b24-c66cbc737cf8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:08.622314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-955dc937-29ce-4ba2-8b24-c66cbc737cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:08.660735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dc937-29ce-4ba2-8b24-c66cbc737cf8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:08.674640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3db695-6883-4188-87f9-3ee9db9dc056 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:08.675327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db695-6883-4188-87f9-3ee9db9dc056 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:08.675445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc58b7-8b86-476a-8029-9eebfe67dbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:08.675610 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db695-6883-4188-87f9-3ee9db9dc056 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:08.675886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3db695-6883-4188-87f9-3ee9db9dc056 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:08.676509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc58b7-8b86-476a-8029-9eebfe67dbce admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:08.677119 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc58b7-8b86-476a-8029-9eebfe67dbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:08.677682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc58b7-8b86-476a-8029-9eebfe67dbce admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:08.678548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc58b7-8b86-476a-8029-9eebfe67dbce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:08.681658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc58b7-8b86-476a-8029-9eebfe67dbce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:08.682392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf3db695-6883-4188-87f9-3ee9db9dc056 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:08.721751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3db695-6883-4188-87f9-3ee9db9dc056 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:08.723233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3db695-6883-4188-87f9-3ee9db9dc056 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:08.748320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 877/1732] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:08.750359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ea9b-4f20-46b9-999f-ee3bbf390e37 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:08.750708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ea9b-4f20-46b9-999f-ee3bbf390e37 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:08.751049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0ea9b-4f20-46b9-999f-ee3bbf390e37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:08.800639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 856/1733] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:08 2022] POST /identity/v3/users => generated 279 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:08.804585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc58b7-8b86-476a-8029-9eebfe67dbce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:08.810150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-93bc58b7-8b86-476a-8029-9eebfe67dbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:08.831769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e7b0ea9b-4f20-46b9-999f-ee3bbf390e37 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:08.846821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e7b0ea9b-4f20-46b9-999f-ee3bbf390e37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:08.860273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 878/1734] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:08.861342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ea9b-4f20-46b9-999f-ee3bbf390e37 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:08.873685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0ea9b-4f20-46b9-999f-ee3bbf390e37 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:08.880298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513629-4fe0-43fe-ab7b-8962a6d33515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:08.881176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513629-4fe0-43fe-ab7b-8962a6d33515 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:08.881560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513629-4fe0-43fe-ab7b-8962a6d33515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:08.881946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d513629-4fe0-43fe-ab7b-8962a6d33515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:08.888664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d513629-4fe0-43fe-ab7b-8962a6d33515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:08.891708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d513629-4fe0-43fe-ab7b-8962a6d33515 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:08.907521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 879/1735] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:08.907521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513629-4fe0-43fe-ab7b-8962a6d33515 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:08.917278 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d513629-4fe0-43fe-ab7b-8962a6d33515 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:08.923228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7ede-4942-44aa-ba5a-85bce51cef45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:08.930302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7ede-4942-44aa-ba5a-85bce51cef45 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:08.930302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7ede-4942-44aa-ba5a-85bce51cef45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:08.930302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df7ede-4942-44aa-ba5a-85bce51cef45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:08.930302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7ede-4942-44aa-ba5a-85bce51cef45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:08.930302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7ede-4942-44aa-ba5a-85bce51cef45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:08.930302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df7ede-4942-44aa-ba5a-85bce51cef45 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:08.954482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 880/1736] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:08.955576 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7ede-4942-44aa-ba5a-85bce51cef45 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:08.960205 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:08.975008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-12df7ede-4942-44aa-ba5a-85bce51cef45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:08.984676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc58b7-8b86-476a-8029-9eebfe67dbce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:08.991956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c0712-4b7c-4db7-a59f-b31360d9fb35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:08.992935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c0712-4b7c-4db7-a59f-b31360d9fb35 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:08.993436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c0712-4b7c-4db7-a59f-b31360d9fb35 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:08.993915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c0712-4b7c-4db7-a59f-b31360d9fb35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:08.996209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9a0c0712-4b7c-4db7-a59f-b31360d9fb35 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:09.079216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df7ede-4942-44aa-ba5a-85bce51cef45 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:09.084712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096755d-9d95-45de-9245-4278057ecce9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e52a3464d8f4a3fa16a102336a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:09.085533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096755d-9d95-45de-9245-4278057ecce9 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:09.085822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096755d-9d95-45de-9245-4278057ecce9 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:09.086097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096755d-9d95-45de-9245-4278057ecce9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:09.088035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e096755d-9d95-45de-9245-4278057ecce9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:09.088683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c0712-4b7c-4db7-a59f-b31360d9fb35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:09.090699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c0712-4b7c-4db7-a59f-b31360d9fb35 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:09.103748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 857/1737] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:09.104327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096755d-9d95-45de-9245-4278057ecce9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:09.105007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c0712-4b7c-4db7-a59f-b31360d9fb35 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:09.107035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096755d-9d95-45de-9245-4278057ecce9 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:09.119815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c0712-4b7c-4db7-a59f-b31360d9fb35 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:09.126512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bdcc7-fcce-4d45-9544-c031237dbac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:09.127282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bdcc7-fcce-4d45-9544-c031237dbac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:09.127623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bdcc7-fcce-4d45-9544-c031237dbac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:09.127909 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bdcc7-fcce-4d45-9544-c031237dbac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:09.128730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bdcc7-fcce-4d45-9544-c031237dbac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:09.130430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bdcc7-fcce-4d45-9544-c031237dbac0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:09.133457 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 881/1738] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:09.150698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 858/1739] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:09.153781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096755d-9d95-45de-9245-4278057ecce9 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:09.155026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bdcc7-fcce-4d45-9544-c031237dbac0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:09.161483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e096755d-9d95-45de-9245-4278057ecce9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:09.203046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096755d-9d95-45de-9245-4278057ecce9 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:09.209783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:09.211447 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:09.211735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:09.212042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] PATH_INFO: `/v3/projects/77da6a994439438789658a6a62fde106` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:09.215035 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bdcc7-fcce-4d45-9544-c031237dbac0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:09.216049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77da6a994439438789658a6a62fde106)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:09.221863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:09.233396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779086eb-cfd0-44e5-8e31-388fb63a4402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:09.234429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779086eb-cfd0-44e5-8e31-388fb63a4402 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:09.240656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779086eb-cfd0-44e5-8e31-388fb63a4402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:09.240963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779086eb-cfd0-44e5-8e31-388fb63a4402 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:09.241777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779086eb-cfd0-44e5-8e31-388fb63a4402 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:09.243985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779086eb-cfd0-44e5-8e31-388fb63a4402 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:09.367323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:09.367691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 859/1740] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:09 2022] POST /identity/v3/projects => generated 365 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:09.372649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779086eb-cfd0-44e5-8e31-388fb63a4402 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:09.399608 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77da6a994439438789658a6a62fde106', 'request_id': 'req-b303256f-fe6d-4663-ab6d-e92e60dedd98'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:09.416570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77da6a994439438789658a6a62fde106', 'request_id': 'req-b303256f-fe6d-4663-ab6d-e92e60dedd98'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:09.495979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779086eb-cfd0-44e5-8e31-388fb63a4402 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:09.504326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77da6a994439438789658a6a62fde106', 'request_id': 'req-b303256f-fe6d-4663-ab6d-e92e60dedd98'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:09.523082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] The token cache is being invalidate because project 77da6a994439438789658a6a62fde106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:09.523388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:09.525076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:09.528186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 882/1741] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:09 2022] DELETE /identity/v3/projects/77da6a994439438789658a6a62fde106 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:09.529515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:09.531630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:09.656455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb562793-516f-4afa-8594-4f82ee660582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:09.657463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb562793-516f-4afa-8594-4f82ee660582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:09.657747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb562793-516f-4afa-8594-4f82ee660582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:09.658030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb562793-516f-4afa-8594-4f82ee660582 admin admin] PATH_INFO: `/v3/projects/35ba0b280599437fb9683a2c9d3b344f/users/4cd7d58b7502486c8dbfe96019397394/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:09.676269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb562793-516f-4afa-8594-4f82ee660582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35ba0b280599437fb9683a2c9d3b344f, user_id=4cd7d58b7502486c8dbfe96019397394, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:09.679271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb562793-516f-4afa-8594-4f82ee660582 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:09.736187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b303256f-fe6d-4663-ab6d-e92e60dedd98 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:09.747150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db49e6-554c-4f28-9aa5-78f878620128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:09.747150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db49e6-554c-4f28-9aa5-78f878620128 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:09.747150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db49e6-554c-4f28-9aa5-78f878620128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:09.747150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db49e6-554c-4f28-9aa5-78f878620128 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:09.753085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db49e6-554c-4f28-9aa5-78f878620128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:09.755748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0db49e6-554c-4f28-9aa5-78f878620128 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:09.822340 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 860/1742] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:09 2022] PUT /identity/v3/projects/35ba0b280599437fb9683a2c9d3b344f/users/4cd7d58b7502486c8dbfe96019397394/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:09.822340 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb562793-516f-4afa-8594-4f82ee660582 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:09.829505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eb562793-516f-4afa-8594-4f82ee660582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:09.894124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 883/1743] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:09 2022] POST /identity/v3/users => generated 283 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:09.895731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09154a6-9cc4-4615-9b2c-6db00258d864 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:09.896176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09154a6-9cc4-4615-9b2c-6db00258d864 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:09.896595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09154a6-9cc4-4615-9b2c-6db00258d864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:09.946159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b09154a6-9cc4-4615-9b2c-6db00258d864 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:09.947725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b09154a6-9cc4-4615-9b2c-6db00258d864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:09.986783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb562793-516f-4afa-8594-4f82ee660582 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:09.993500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:09.994617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:09.995008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:09.995725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] PATH_INFO: `/v3/projects/10d85f059477452ca979d610bd83725e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:09.998133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d85f059477452ca979d610bd83725e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:09.999757 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:10.087686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 884/1744] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:10.092072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a137fe4-6e09-458f-a165-6a689146f560 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:10.092361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a137fe4-6e09-458f-a165-6a689146f560 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:10.093173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a137fe4-6e09-458f-a165-6a689146f560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:10.165864 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4a137fe4-6e09-458f-a165-6a689146f560 None None] MFA Rules not processed for user `4cd7d58b7502486c8dbfe96019397394`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:10.165864 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4a137fe4-6e09-458f-a165-6a689146f560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:10.168916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d85f059477452ca979d610bd83725e', 'request_id': 'req-a074e5e8-e9c8-463b-90a7-7d0c1421c099'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:10.176674 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d85f059477452ca979d610bd83725e', 'request_id': 'req-a074e5e8-e9c8-463b-90a7-7d0c1421c099'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:10.300069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d85f059477452ca979d610bd83725e', 'request_id': 'req-a074e5e8-e9c8-463b-90a7-7d0c1421c099'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:10.306630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 885/1745] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:10 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:10.309103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a137fe4-6e09-458f-a165-6a689146f560 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:10.325832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] The token cache is being invalidate because project 10d85f059477452ca979d610bd83725e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:10.326458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:10.329420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a074e5e8-e9c8-463b-90a7-7d0c1421c099 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:10.356815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 861/1746] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:09 2022] DELETE /identity/v3/projects/10d85f059477452ca979d610bd83725e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:10.356815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f3f37-9414-4055-a391-16c9189195af None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:10.356815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f3f37-9414-4055-a391-16c9189195af None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:10.356815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67f3f37-9414-4055-a391-16c9189195af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:10.388051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d67f3f37-9414-4055-a391-16c9189195af None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:10.392288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d67f3f37-9414-4055-a391-16c9189195af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:10.456525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a137fe4-6e09-458f-a165-6a689146f560 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:10.464275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de5e8-9ad7-4d4a-8da3-8848f4e0559e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:10.464956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de5e8-9ad7-4d4a-8da3-8848f4e0559e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:10.465236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de5e8-9ad7-4d4a-8da3-8848f4e0559e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:10.465503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424de5e8-9ad7-4d4a-8da3-8848f4e0559e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:10.473782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de5e8-9ad7-4d4a-8da3-8848f4e0559e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:10.478542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424de5e8-9ad7-4d4a-8da3-8848f4e0559e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:10.493998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 886/1747] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:10.495122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de5e8-9ad7-4d4a-8da3-8848f4e0559e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:10.497864 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-424de5e8-9ad7-4d4a-8da3-8848f4e0559e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:10.511329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424de5e8-9ad7-4d4a-8da3-8848f4e0559e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:10.518502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46556682-dec2-4275-9c25-c51236227b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:10.520213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46556682-dec2-4275-9c25-c51236227b6c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:10.520213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46556682-dec2-4275-9c25-c51236227b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:10.520213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46556682-dec2-4275-9c25-c51236227b6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:10.521129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46556682-dec2-4275-9c25-c51236227b6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:10.530394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46556682-dec2-4275-9c25-c51236227b6c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:10.551085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 862/1748] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:10.552144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f3f37-9414-4055-a391-16c9189195af None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:10.553476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d67f3f37-9414-4055-a391-16c9189195af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:10.571530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67f3f37-9414-4055-a391-16c9189195af None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:10.576910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:10.586498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:10.586498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:10.586498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] PATH_INFO: `/v3/users/7659ef1e6cda45dc822c19dc8192188f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:10.586498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7659ef1e6cda45dc822c19dc8192188f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:10.586498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:10.655804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 887/1749] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:10 2022] POST /identity/v3/projects => generated 357 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:10.655804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46556682-dec2-4275-9c25-c51236227b6c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:10.657160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-46556682-dec2-4275-9c25-c51236227b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:10.715017 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:10.780669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:10.810066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46556682-dec2-4275-9c25-c51236227b6c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:10.833574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d369871-4390-4bf1-9acc-4d0aeda24459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:10.834580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d369871-4390-4bf1-9acc-4d0aeda24459 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:10.834890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d369871-4390-4bf1-9acc-4d0aeda24459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:10.835168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d369871-4390-4bf1-9acc-4d0aeda24459 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:10.835931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d369871-4390-4bf1-9acc-4d0aeda24459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:10.837801 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d369871-4390-4bf1-9acc-4d0aeda24459 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:10.872324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7659ef1e6cda45dc822c19dc8192188f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:10.877302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 888/1750] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:10.878839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d369871-4390-4bf1-9acc-4d0aeda24459 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:10.903143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7659ef1e6cda45dc822c19dc8192188f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:10.918615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d369871-4390-4bf1-9acc-4d0aeda24459 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:10.923968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7659ef1e6cda45dc822c19dc8192188f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:10.924979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7659ef1e6cda45dc822c19dc8192188f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:10.926214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-26036dd0-365e-4498-907c-1237ec2ec384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7659ef1e6cda45dc822c19dc8192188f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:10.929809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb6560-0036-45bf-95ed-0beb3a5aa05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:10.931782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb6560-0036-45bf-95ed-0beb3a5aa05b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:10.932248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb6560-0036-45bf-95ed-0beb3a5aa05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:10.932664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdb6560-0036-45bf-95ed-0beb3a5aa05b admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:10.934018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb6560-0036-45bf-95ed-0beb3a5aa05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:10.934621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb6560-0036-45bf-95ed-0beb3a5aa05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:10.938807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdb6560-0036-45bf-95ed-0beb3a5aa05b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:10.971669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 889/1751] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:10.971669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb6560-0036-45bf-95ed-0beb3a5aa05b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:10.971669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-efdb6560-0036-45bf-95ed-0beb3a5aa05b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:10.994115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdb6560-0036-45bf-95ed-0beb3a5aa05b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:11.015958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bb025-d1fc-4a33-9d7b-f7edb44e64f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:11.017846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bb025-d1fc-4a33-9d7b-f7edb44e64f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:11.018582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bb025-d1fc-4a33-9d7b-f7edb44e64f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:11.019563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16bb025-d1fc-4a33-9d7b-f7edb44e64f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:11.020935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bb025-d1fc-4a33-9d7b-f7edb44e64f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:11.023843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16bb025-d1fc-4a33-9d7b-f7edb44e64f0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:11.095963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 863/1752] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:10 2022] DELETE /identity/v3/users/7659ef1e6cda45dc822c19dc8192188f => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:11.097885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45d16b-37fe-46b6-adf8-63596b55b8db None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:11.099351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45d16b-37fe-46b6-adf8-63596b55b8db None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:11.099729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c45d16b-37fe-46b6-adf8-63596b55b8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:11.156870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5c45d16b-37fe-46b6-adf8-63596b55b8db None None] MFA Rules not processed for user `66801c15461d4b419949b4959805306a`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:11.161805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5c45d16b-37fe-46b6-adf8-63596b55b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:11.189265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 890/1753] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:10 2022] POST /identity/v3/users => generated 285 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:11.189265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bb025-d1fc-4a33-9d7b-f7edb44e64f0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:11.203143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c16bb025-d1fc-4a33-9d7b-f7edb44e64f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:11.240973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16bb025-d1fc-4a33-9d7b-f7edb44e64f0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:11.314504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 864/1754] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:11.316261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45d16b-37fe-46b6-adf8-63596b55b8db None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:11.317921 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5c45d16b-37fe-46b6-adf8-63596b55b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:11.414611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caba04-0311-43d4-8dcc-4489055a1164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:11.416420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caba04-0311-43d4-8dcc-4489055a1164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:11.418387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caba04-0311-43d4-8dcc-4489055a1164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:11.419419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caba04-0311-43d4-8dcc-4489055a1164 admin admin] PATH_INFO: `/v3/projects/46972fd7bd6d4d1a9bd7d5b2224bb478/users/bc31aa4fb4a64718ac87b4ca22324a9d/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:11.459147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caba04-0311-43d4-8dcc-4489055a1164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46972fd7bd6d4d1a9bd7d5b2224bb478, user_id=bc31aa4fb4a64718ac87b4ca22324a9d, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:11.460435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caba04-0311-43d4-8dcc-4489055a1164 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:11.552833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c45d16b-37fe-46b6-adf8-63596b55b8db None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:11.574701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533c877-2a26-4282-bc74-7468046d5b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:11.575532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533c877-2a26-4282-bc74-7468046d5b4c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:11.575655 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533c877-2a26-4282-bc74-7468046d5b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:11.576056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533c877-2a26-4282-bc74-7468046d5b4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:11.576774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533c877-2a26-4282-bc74-7468046d5b4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:11.579767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6533c877-2a26-4282-bc74-7468046d5b4c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:11.604512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 891/1755] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:11 2022] PUT /identity/v3/projects/46972fd7bd6d4d1a9bd7d5b2224bb478/users/bc31aa4fb4a64718ac87b4ca22324a9d/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:11.606008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caba04-0311-43d4-8dcc-4489055a1164 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:11.707529 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 865/1756] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:11 2022] POST /identity/v3/projects => generated 363 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:11.709502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c0f0-1785-41bd-b3a0-34bbc6ebdc41 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:11.713004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c0f0-1785-41bd-b3a0-34bbc6ebdc41 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:11.716312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983c0f0-1785-41bd-b3a0-34bbc6ebdc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:11.818003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f983c0f0-1785-41bd-b3a0-34bbc6ebdc41 None None] MFA Rules not processed for user `bc31aa4fb4a64718ac87b4ca22324a9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:11.821517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f983c0f0-1785-41bd-b3a0-34bbc6ebdc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:11.833976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caba04-0311-43d4-8dcc-4489055a1164 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:11.997936 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 866/1757] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:11.999072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983c0f0-1785-41bd-b3a0-34bbc6ebdc41 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:12.004439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f51ad6-89a6-49bb-8fc4-bcf18e9c9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:12.005947 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51ad6-89a6-49bb-8fc4-bcf18e9c9f9a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.006252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51ad6-89a6-49bb-8fc4-bcf18e9c9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.006511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f51ad6-89a6-49bb-8fc4-bcf18e9c9f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.009654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f51ad6-89a6-49bb-8fc4-bcf18e9c9f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:12.013841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f51ad6-89a6-49bb-8fc4-bcf18e9c9f9a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:12.038695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983c0f0-1785-41bd-b3a0-34bbc6ebdc41 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:12.043090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e525c-4090-4498-b7e3-25c81ca01ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:12.043954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e525c-4090-4498-b7e3-25c81ca01ffd admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.044103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e525c-4090-4498-b7e3-25c81ca01ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.044442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e525c-4090-4498-b7e3-25c81ca01ffd admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.045028 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e525c-4090-4498-b7e3-25c81ca01ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:12.047104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e525c-4090-4498-b7e3-25c81ca01ffd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:12.047762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 892/1758] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:12.049679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780aaa0-57a5-4ca5-9782-4b5a80181ea3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.049805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780aaa0-57a5-4ca5-9782-4b5a80181ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.050032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780aaa0-57a5-4ca5-9782-4b5a80181ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.076662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5780aaa0-57a5-4ca5-9782-4b5a80181ea3 None None] MFA Rules not processed for user `c1c4f2a6178140858efd4599a3f975d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:12.082260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5780aaa0-57a5-4ca5-9782-4b5a80181ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:12.174431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 867/1759] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:11 2022] POST /identity/v3/users => generated 282 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:12.176300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e525c-4090-4498-b7e3-25c81ca01ffd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:12.197794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e525c-4090-4498-b7e3-25c81ca01ffd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:12.216361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a037a-728d-4234-b7d1-5b8f2cae6a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:12.217273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a037a-728d-4234-b7d1-5b8f2cae6a16 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.218339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a037a-728d-4234-b7d1-5b8f2cae6a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.219086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a037a-728d-4234-b7d1-5b8f2cae6a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.219998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a037a-728d-4234-b7d1-5b8f2cae6a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:12.227159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a037a-728d-4234-b7d1-5b8f2cae6a16 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:12.242608 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 893/1760] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:12.243583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780aaa0-57a5-4ca5-9782-4b5a80181ea3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:12.295414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780aaa0-57a5-4ca5-9782-4b5a80181ea3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:12.304604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2a446-089d-41f9-b121-86444356a40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:12.306195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2a446-089d-41f9-b121-86444356a40e admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.306195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2a446-089d-41f9-b121-86444356a40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.306195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2a446-089d-41f9-b121-86444356a40e admin admin] PATH_INFO: `/v3/projects/b185593b75c3407388450c0c20c73b5d/users/47e500a3c6c9425e8414a4a3fc5d7832/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.351610 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2a446-089d-41f9-b121-86444356a40e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b185593b75c3407388450c0c20c73b5d, user_id=47e500a3c6c9425e8414a4a3fc5d7832, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:12.352923 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2a446-089d-41f9-b121-86444356a40e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:12.416636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 868/1761] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:12 2022] POST /identity/v3/projects => generated 363 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:12.416636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a037a-728d-4234-b7d1-5b8f2cae6a16 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:12.460782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 894/1762] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:12 2022] PUT /identity/v3/projects/b185593b75c3407388450c0c20c73b5d/users/47e500a3c6c9425e8414a4a3fc5d7832/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:12.460782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2a446-089d-41f9-b121-86444356a40e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:12.577118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2a446-089d-41f9-b121-86444356a40e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:12.583754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a037a-728d-4234-b7d1-5b8f2cae6a16 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:12.587390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a7c6-3ad6-49a5-980b-ecf9e5c911e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:12.588881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a7c6-3ad6-49a5-980b-ecf9e5c911e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.589372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a7c6-3ad6-49a5-980b-ecf9e5c911e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.591815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762bab-c742-4881-bae7-a5aaf7750026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:12.594336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762bab-c742-4881-bae7-a5aaf7750026 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.594751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762bab-c742-4881-bae7-a5aaf7750026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.595150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df762bab-c742-4881-bae7-a5aaf7750026 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.596035 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df762bab-c742-4881-bae7-a5aaf7750026 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:12.598024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df762bab-c742-4881-bae7-a5aaf7750026 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:12.601953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62a7c6-3ad6-49a5-980b-ecf9e5c911e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.603897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a7c6-3ad6-49a5-980b-ecf9e5c911e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:12.609972 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb62a7c6-3ad6-49a5-980b-ecf9e5c911e3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:12.622378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 869/1763] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:12.624273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762bab-c742-4881-bae7-a5aaf7750026 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:12.679024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df762bab-c742-4881-bae7-a5aaf7750026 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:12.692056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed68e9-48ee-41a6-8c7e-0e47e24b9a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:12.693559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed68e9-48ee-41a6-8c7e-0e47e24b9a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.694625 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed68e9-48ee-41a6-8c7e-0e47e24b9a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.696210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed68e9-48ee-41a6-8c7e-0e47e24b9a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.697220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed68e9-48ee-41a6-8c7e-0e47e24b9a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:12.699235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed68e9-48ee-41a6-8c7e-0e47e24b9a31 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:12.716723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 870/1764] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:12.718942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed68e9-48ee-41a6-8c7e-0e47e24b9a31 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:12.721315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4fed68e9-48ee-41a6-8c7e-0e47e24b9a31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:12.735292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 895/1765] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:12 2022] POST /identity/v3/users => generated 288 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:12.735292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a7c6-3ad6-49a5-980b-ecf9e5c911e3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:12.750215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb62a7c6-3ad6-49a5-980b-ecf9e5c911e3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:12.756895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0daf-fa93-4b0c-b0f2-fd7fd050137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:12.758525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0daf-fa93-4b0c-b0f2-fd7fd050137a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.758819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0daf-fa93-4b0c-b0f2-fd7fd050137a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.759157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d0daf-fa93-4b0c-b0f2-fd7fd050137a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.760033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d0daf-fa93-4b0c-b0f2-fd7fd050137a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:12.761409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed68e9-48ee-41a6-8c7e-0e47e24b9a31 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:12.762640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d0daf-fa93-4b0c-b0f2-fd7fd050137a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:12.777680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:12.778807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.779164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.779446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] PATH_INFO: `/v3/projects/0021f19841974a2ba16e77369193b11f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.784454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0021f19841974a2ba16e77369193b11f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:12.786941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:12.789553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 896/1766] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:12.790786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0daf-fa93-4b0c-b0f2-fd7fd050137a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:12.831714 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d0daf-fa93-4b0c-b0f2-fd7fd050137a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:12.855046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5229f69-d2ff-47b8-a964-500f07bef961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:12.858884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5229f69-d2ff-47b8-a964-500f07bef961 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:12.859359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5229f69-d2ff-47b8-a964-500f07bef961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:12.859782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5229f69-d2ff-47b8-a964-500f07bef961 admin admin] PATH_INFO: `/v3/projects/b185593b75c3407388450c0c20c73b5d/users/47e500a3c6c9425e8414a4a3fc5d7832/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:12.865103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5229f69-d2ff-47b8-a964-500f07bef961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b185593b75c3407388450c0c20c73b5d, user_id=47e500a3c6c9425e8414a4a3fc5d7832, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:12.874530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5229f69-d2ff-47b8-a964-500f07bef961 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:12.913102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 897/1767] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:12 2022] PUT /identity/v3/projects/b185593b75c3407388450c0c20c73b5d/users/47e500a3c6c9425e8414a4a3fc5d7832/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:12.916277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5229f69-d2ff-47b8-a964-500f07bef961 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:13.040546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5229f69-d2ff-47b8-a964-500f07bef961 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:13.048329 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0021f19841974a2ba16e77369193b11f', 'request_id': 'req-4f0b195f-3967-4259-8483-10ec9028cd0f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:13.049556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:13.056725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0021f19841974a2ba16e77369193b11f', 'request_id': 'req-4f0b195f-3967-4259-8483-10ec9028cd0f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:13.157366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0021f19841974a2ba16e77369193b11f', 'request_id': 'req-4f0b195f-3967-4259-8483-10ec9028cd0f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:13.159825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:13.180765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] The token cache is being invalidate because project 0021f19841974a2ba16e77369193b11f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:13.181072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:13.183607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:13.184257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a32d2c-f00c-470a-a220-8371e15fe150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:13.190894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a32d2c-f00c-470a-a220-8371e15fe150 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:13.191202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a32d2c-f00c-470a-a220-8371e15fe150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:13.191483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a32d2c-f00c-470a-a220-8371e15fe150 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:13.193187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 871/1768] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:12 2022] DELETE /identity/v3/projects/0021f19841974a2ba16e77369193b11f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:13.194051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:13.196647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a32d2c-f00c-470a-a220-8371e15fe150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:13.198215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a32d2c-f00c-470a-a220-8371e15fe150 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:13.199262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:13.234638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b195f-3967-4259-8483-10ec9028cd0f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:13.236494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 898/1769] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:13.239144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f94a8-67f9-4acc-b2d4-e15248ff1893 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:13.239851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f94a8-67f9-4acc-b2d4-e15248ff1893 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:13.240451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f94a8-67f9-4acc-b2d4-e15248ff1893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:13.244300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36012c5d-86de-4da6-b394-6ec9aef96e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:13.245362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36012c5d-86de-4da6-b394-6ec9aef96e25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:13.245701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36012c5d-86de-4da6-b394-6ec9aef96e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:13.246069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36012c5d-86de-4da6-b394-6ec9aef96e25 admin admin] PATH_INFO: `/v3/projects/1a373d8631704fd2bf3009113511267f/users/af2b53c115c04d739d1ef3b7c5936052/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:13.265750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36012c5d-86de-4da6-b394-6ec9aef96e25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a373d8631704fd2bf3009113511267f, user_id=af2b53c115c04d739d1ef3b7c5936052, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:13.269135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36012c5d-86de-4da6-b394-6ec9aef96e25 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:13.282120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4a0f94a8-67f9-4acc-b2d4-e15248ff1893 None None] MFA Rules not processed for user `47e500a3c6c9425e8414a4a3fc5d7832`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:13.283897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4a0f94a8-67f9-4acc-b2d4-e15248ff1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:13.362243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 872/1770] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:13 2022] PUT /identity/v3/projects/1a373d8631704fd2bf3009113511267f/users/af2b53c115c04d739d1ef3b7c5936052/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:13.365703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e9112-3211-4cf5-8cf7-b5036e96cc86 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:13.366628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e9112-3211-4cf5-8cf7-b5036e96cc86 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:13.369460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e9112-3211-4cf5-8cf7-b5036e96cc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:13.411497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5a9e9112-3211-4cf5-8cf7-b5036e96cc86 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:13.412912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5a9e9112-3211-4cf5-8cf7-b5036e96cc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:13.451717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 899/1771] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:13.456672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f94a8-67f9-4acc-b2d4-e15248ff1893 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:13.457682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4a0f94a8-67f9-4acc-b2d4-e15248ff1893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:13.477259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0f94a8-67f9-4acc-b2d4-e15248ff1893 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:13.522752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 873/1772] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:13.524846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd1858-55fe-4493-8a65-24dee2b57595 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:13.525439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd1858-55fe-4493-8a65-24dee2b57595 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:13.525915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd1858-55fe-4493-8a65-24dee2b57595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:13.615311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8dbd1858-55fe-4493-8a65-24dee2b57595 None None] MFA Rules not processed for user `af2b53c115c04d739d1ef3b7c5936052`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:13.616714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8dbd1858-55fe-4493-8a65-24dee2b57595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:13.680851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8982b-cf5f-4f4b-8de8-e7bae53a179a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:13.682082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8982b-cf5f-4f4b-8de8-e7bae53a179a admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:13.683619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8982b-cf5f-4f4b-8de8-e7bae53a179a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:13.684105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8982b-cf5f-4f4b-8de8-e7bae53a179a admin admin] PATH_INFO: `/v3/projects/1c1e378f18e043aa95d486c18ec756df/users/e64d98d0d72f46bcb22b96624998f4a1/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:13.724391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8982b-cf5f-4f4b-8de8-e7bae53a179a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e378f18e043aa95d486c18ec756df, user_id=e64d98d0d72f46bcb22b96624998f4a1, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:13.748269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8982b-cf5f-4f4b-8de8-e7bae53a179a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:13.828887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 874/1773] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:13.830050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd1858-55fe-4493-8a65-24dee2b57595 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:13.834447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8dbd1858-55fe-4493-8a65-24dee2b57595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:13.922643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 900/1774] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:13 2022] PUT /identity/v3/projects/1c1e378f18e043aa95d486c18ec756df/users/e64d98d0d72f46bcb22b96624998f4a1/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:13.922643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf14b3-787a-4022-9a97-c4fd0aec422c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:13.922643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf14b3-787a-4022-9a97-c4fd0aec422c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:13.922643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cf14b3-787a-4022-9a97-c4fd0aec422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:13.941546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-41cf14b3-787a-4022-9a97-c4fd0aec422c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:13.943531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-41cf14b3-787a-4022-9a97-c4fd0aec422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:13.957243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd1858-55fe-4493-8a65-24dee2b57595 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:14.136785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 901/1775] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:14.147153 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf14b3-787a-4022-9a97-c4fd0aec422c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:14.158880 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f713f54-5263-4ae5-8f0c-29646f614cca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:14.159454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f713f54-5263-4ae5-8f0c-29646f614cca service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:14.159741 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f713f54-5263-4ae5-8f0c-29646f614cca service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:14.160046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f713f54-5263-4ae5-8f0c-29646f614cca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:14.175178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cf14b3-787a-4022-9a97-c4fd0aec422c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:14.195306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:14.195684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f160-d8f0-4325-8181-fe7cec4410e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:14.196494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f160-d8f0-4325-8181-fe7cec4410e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:14.200489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f160-d8f0-4325-8181-fe7cec4410e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:14.200880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7f160-d8f0-4325-8181-fe7cec4410e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:14.201685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7f160-d8f0-4325-8181-fe7cec4410e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:14.207408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7f160-d8f0-4325-8181-fe7cec4410e1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:14.305309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f713f54-5263-4ae5-8f0c-29646f614cca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:14.306957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f713f54-5263-4ae5-8f0c-29646f614cca service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:14.334109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 875/1776] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:13 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:14.336835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f713f54-5263-4ae5-8f0c-29646f614cca service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:14.357959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f713f54-5263-4ae5-8f0c-29646f614cca service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:14.384493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e1aa-a557-4525-8b54-9f1a0e62ce3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:14.388940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e1aa-a557-4525-8b54-9f1a0e62ce3c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:14.389234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e1aa-a557-4525-8b54-9f1a0e62ce3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:14.394650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35e1aa-a557-4525-8b54-9f1a0e62ce3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:14.400973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 902/1777] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:14 2022] POST /identity/v3/projects => generated 365 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:14.404297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f160-d8f0-4325-8181-fe7cec4410e1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:14.407306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35e1aa-a557-4525-8b54-9f1a0e62ce3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:14.413618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a35e1aa-a557-4525-8b54-9f1a0e62ce3c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:14.434874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 876/1778] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:14.434874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e1aa-a557-4525-8b54-9f1a0e62ce3c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:14.448057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a35e1aa-a557-4525-8b54-9f1a0e62ce3c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:14.604054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2ab0-a984-4027-ad76-ac415ee67cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:14.604762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2ab0-a984-4027-ad76-ac415ee67cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:14.605047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2ab0-a984-4027-ad76-ac415ee67cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:14.605380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2ab0-a984-4027-ad76-ac415ee67cbd admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:14.606065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2ab0-a984-4027-ad76-ac415ee67cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:14.612986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2ab0-a984-4027-ad76-ac415ee67cbd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:14.624258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7f160-d8f0-4325-8181-fe7cec4410e1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:14.639949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ec55c-410f-4b8b-b76c-1436c50907a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:14.641649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ec55c-410f-4b8b-b76c-1436c50907a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:14.641649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ec55c-410f-4b8b-b76c-1436c50907a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:14.642135 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ec55c-410f-4b8b-b76c-1436c50907a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:14.643084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ec55c-410f-4b8b-b76c-1436c50907a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:14.643599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ec55c-410f-4b8b-b76c-1436c50907a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:14.645478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ec55c-410f-4b8b-b76c-1436c50907a6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:14.659200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 903/1779] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:14.663823 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ec55c-410f-4b8b-b76c-1436c50907a6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:14.685458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ec55c-410f-4b8b-b76c-1436c50907a6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:14.691163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d570aca-3e54-43c6-a446-d279b8d05bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:14.693067 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d570aca-3e54-43c6-a446-d279b8d05bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:14.693530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d570aca-3e54-43c6-a446-d279b8d05bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:14.694089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d570aca-3e54-43c6-a446-d279b8d05bb2 admin admin] PATH_INFO: `/v3/projects/1c1e378f18e043aa95d486c18ec756df/users/e64d98d0d72f46bcb22b96624998f4a1/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:14.697027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d570aca-3e54-43c6-a446-d279b8d05bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c1e378f18e043aa95d486c18ec756df, user_id=e64d98d0d72f46bcb22b96624998f4a1, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:14.700292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d570aca-3e54-43c6-a446-d279b8d05bb2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:14.747767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 904/1780] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:14 2022] PUT /identity/v3/projects/1c1e378f18e043aa95d486c18ec756df/users/e64d98d0d72f46bcb22b96624998f4a1/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:14.747767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d570aca-3e54-43c6-a446-d279b8d05bb2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:14.766848 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 877/1781] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:14 2022] POST /identity/v3/users => generated 289 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:14.769234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2ab0-a984-4027-ad76-ac415ee67cbd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:14.857437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2ab0-a984-4027-ad76-ac415ee67cbd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:14.869643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d570aca-3e54-43c6-a446-d279b8d05bb2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:14.876887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae0e92-843e-43b3-a40d-0bef73a5e068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:14.877710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae0e92-843e-43b3-a40d-0bef73a5e068 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:14.878006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae0e92-843e-43b3-a40d-0bef73a5e068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:14.878292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae0e92-843e-43b3-a40d-0bef73a5e068 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:14.879239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae0e92-843e-43b3-a40d-0bef73a5e068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:14.881568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ae0e92-843e-43b3-a40d-0bef73a5e068 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:14.999117 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 905/1782] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:14 2022] POST /identity/v3/projects => generated 385 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:15.000660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516fee-b486-439e-8f54-49ca50a84cfa None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:15.003119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516fee-b486-439e-8f54-49ca50a84cfa None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:15.003412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00516fee-b486-439e-8f54-49ca50a84cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:15.026171 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8606479-0135-41a2-a20b-160f36de7577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:15.027960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8606479-0135-41a2-a20b-160f36de7577 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:15.028253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8606479-0135-41a2-a20b-160f36de7577 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:15.028530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8606479-0135-41a2-a20b-160f36de7577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:15.036031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a8606479-0135-41a2-a20b-160f36de7577 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:15.083790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-00516fee-b486-439e-8f54-49ca50a84cfa None None] MFA Rules not processed for user `e64d98d0d72f46bcb22b96624998f4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:15.086397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-00516fee-b486-439e-8f54-49ca50a84cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:15.192403 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8606479-0135-41a2-a20b-160f36de7577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:15.194152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8606479-0135-41a2-a20b-160f36de7577 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:15.218169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 878/1783] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:14 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:15.226119 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8606479-0135-41a2-a20b-160f36de7577 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:15.285001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8606479-0135-41a2-a20b-160f36de7577 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:15.292664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 906/1784] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:14 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:15.293790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00516fee-b486-439e-8f54-49ca50a84cfa None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:15.413798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b2f1b4-33f0-47c7-9ef6-84e7c25ce28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:15.415162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2f1b4-33f0-47c7-9ef6-84e7c25ce28d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:15.415507 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2f1b4-33f0-47c7-9ef6-84e7c25ce28d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:15.415893 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b2f1b4-33f0-47c7-9ef6-84e7c25ce28d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:15.417105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2f1b4-33f0-47c7-9ef6-84e7c25ce28d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:15.419078 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b2f1b4-33f0-47c7-9ef6-84e7c25ce28d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:15.440336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 879/1785] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:15.443178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68871b4f-72f8-47e0-9bb0-9062935f0125 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:15.443474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68871b4f-72f8-47e0-9bb0-9062935f0125 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:15.443757 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68871b4f-72f8-47e0-9bb0-9062935f0125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:15.452920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00516fee-b486-439e-8f54-49ca50a84cfa None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:15.468115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17dd18-0838-47bb-b36e-097b283e7524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:15.468981 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17dd18-0838-47bb-b36e-097b283e7524 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:15.469361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17dd18-0838-47bb-b36e-097b283e7524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:15.469736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17dd18-0838-47bb-b36e-097b283e7524 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:15.470598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17dd18-0838-47bb-b36e-097b283e7524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:15.472713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17dd18-0838-47bb-b36e-097b283e7524 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:15.538888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-68871b4f-72f8-47e0-9bb0-9062935f0125 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:15.540315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-68871b4f-72f8-47e0-9bb0-9062935f0125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:15.594065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 907/1786] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:15 2022] POST /identity/v3/users => generated 293 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:15.595743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17dd18-0838-47bb-b36e-097b283e7524 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:15.600339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4c17dd18-0838-47bb-b36e-097b283e7524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:15.677482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 880/1787] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:10:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:15.678808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68871b4f-72f8-47e0-9bb0-9062935f0125 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:15.715134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68871b4f-72f8-47e0-9bb0-9062935f0125 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:15.721282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec642c-115b-4182-a7bd-2914f03d07c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:15.722284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec642c-115b-4182-a7bd-2914f03d07c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:15.722489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec642c-115b-4182-a7bd-2914f03d07c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:15.722774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec642c-115b-4182-a7bd-2914f03d07c0 admin admin] PATH_INFO: `/v3/projects/a44d06703dca45edb1d4288b1397beca/users/37c9b3d5bfaf41ff9e70b97b2a97ed00/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:15.729372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17dd18-0838-47bb-b36e-097b283e7524 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:15.734518 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f20c-3cf8-4460-88ba-f167fe761462 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:15.735659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f20c-3cf8-4460-88ba-f167fe761462 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:15.738139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f20c-3cf8-4460-88ba-f167fe761462 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:15.738139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137f20c-3cf8-4460-88ba-f167fe761462 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:15.757809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f20c-3cf8-4460-88ba-f167fe761462 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:15.759565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137f20c-3cf8-4460-88ba-f167fe761462 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:15.773622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec642c-115b-4182-a7bd-2914f03d07c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44d06703dca45edb1d4288b1397beca, user_id=37c9b3d5bfaf41ff9e70b97b2a97ed00, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:15.779507 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bec642c-115b-4182-a7bd-2914f03d07c0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:15.798667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 908/1788] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:15 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:15.803438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f20c-3cf8-4460-88ba-f167fe761462 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:15.825182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137f20c-3cf8-4460-88ba-f167fe761462 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:15.851483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf46a-0315-492f-8482-499d6dc16aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:15.856263 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf46a-0315-492f-8482-499d6dc16aea admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:15.856706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf46a-0315-492f-8482-499d6dc16aea admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:15.857137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adf46a-0315-492f-8482-499d6dc16aea admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:15.861494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf46a-0315-492f-8482-499d6dc16aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:15.869825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65adf46a-0315-492f-8482-499d6dc16aea admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:15.900473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 909/1789] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:15.906061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf46a-0315-492f-8482-499d6dc16aea admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:15.919749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65adf46a-0315-492f-8482-499d6dc16aea admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:15.927609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6eb46-4671-4198-9d82-959ab7b295ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:15.928614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6eb46-4671-4198-9d82-959ab7b295ce admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:15.928903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6eb46-4671-4198-9d82-959ab7b295ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:15.929233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd6eb46-4671-4198-9d82-959ab7b295ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:15.929978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6eb46-4671-4198-9d82-959ab7b295ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:15.931734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd6eb46-4671-4198-9d82-959ab7b295ce admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:15.951032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 910/1790] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:10:15.953773 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6eb46-4671-4198-9d82-959ab7b295ce admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:15.955351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 881/1791] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:15 2022] PUT /identity/v3/projects/a44d06703dca45edb1d4288b1397beca/users/37c9b3d5bfaf41ff9e70b97b2a97ed00/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:15.960030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec642c-115b-4182-a7bd-2914f03d07c0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:16.011227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd6eb46-4671-4198-9d82-959ab7b295ce admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:16.141564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec642c-115b-4182-a7bd-2914f03d07c0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:16.165744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08f3bb-e595-4fbe-b6bd-5013f836188c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:16.167009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08f3bb-e595-4fbe-b6bd-5013f836188c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:16.167338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08f3bb-e595-4fbe-b6bd-5013f836188c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:16.167602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08f3bb-e595-4fbe-b6bd-5013f836188c admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:16.168427 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08f3bb-e595-4fbe-b6bd-5013f836188c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:16.170440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08f3bb-e595-4fbe-b6bd-5013f836188c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:16.199014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 882/1792] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:16.199997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08f3bb-e595-4fbe-b6bd-5013f836188c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:16.225990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08f3bb-e595-4fbe-b6bd-5013f836188c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:16.242026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a43f7-6e46-4120-8664-1ec2b11cc3eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:16.242952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a43f7-6e46-4120-8664-1ec2b11cc3eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:16.243590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a43f7-6e46-4120-8664-1ec2b11cc3eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:16.243717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a43f7-6e46-4120-8664-1ec2b11cc3eb admin admin] PATH_INFO: `/v3/projects/a44d06703dca45edb1d4288b1397beca/users/37c9b3d5bfaf41ff9e70b97b2a97ed00/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:16.252741 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:16.253744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a43f7-6e46-4120-8664-1ec2b11cc3eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a44d06703dca45edb1d4288b1397beca, user_id=37c9b3d5bfaf41ff9e70b97b2a97ed00, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:16.256901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a43f7-6e46-4120-8664-1ec2b11cc3eb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:16.287082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 883/1793] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:16 2022] PUT /identity/v3/projects/a44d06703dca45edb1d4288b1397beca/users/37c9b3d5bfaf41ff9e70b97b2a97ed00/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:16.294143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a43f7-6e46-4120-8664-1ec2b11cc3eb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:16.301549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236002a-fa9f-4998-9083-206633c4744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:16.302655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236002a-fa9f-4998-9083-206633c4744b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:16.303108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236002a-fa9f-4998-9083-206633c4744b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:16.303466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236002a-fa9f-4998-9083-206633c4744b admin admin] PATH_INFO: `/v3/projects/c35263a53f8d4f2fae296e81af20cf11/users/539a69a2a5fd47d9b2ab7270954d7132/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:16.375387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236002a-fa9f-4998-9083-206633c4744b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c35263a53f8d4f2fae296e81af20cf11, user_id=539a69a2a5fd47d9b2ab7270954d7132, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:16.404541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236002a-fa9f-4998-9083-206633c4744b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:16.508343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a43f7-6e46-4120-8664-1ec2b11cc3eb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:16.521707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a043146-376f-4a0f-bc8e-c17362484604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:16.522730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a043146-376f-4a0f-bc8e-c17362484604 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:16.523220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a043146-376f-4a0f-bc8e-c17362484604 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:16.523651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a043146-376f-4a0f-bc8e-c17362484604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:16.528063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5a043146-376f-4a0f-bc8e-c17362484604 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:16.598853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 911/1794] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:15 2022] PUT /identity/v3/projects/c35263a53f8d4f2fae296e81af20cf11/users/539a69a2a5fd47d9b2ab7270954d7132/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 627 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:16.605501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236002a-fa9f-4998-9083-206633c4744b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:16.621466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f236002a-fa9f-4998-9083-206633c4744b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:16.696553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a043146-376f-4a0f-bc8e-c17362484604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:16.698626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a043146-376f-4a0f-bc8e-c17362484604 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:16.720284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 884/1795] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:16 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:16.724121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff58865-8a9d-4f6f-bffc-03a9e21c5c7a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:16.724409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff58865-8a9d-4f6f-bffc-03a9e21c5c7a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:16.724687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff58865-8a9d-4f6f-bffc-03a9e21c5c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:16.804014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3ff58865-8a9d-4f6f-bffc-03a9e21c5c7a None None] MFA Rules not processed for user `37c9b3d5bfaf41ff9e70b97b2a97ed00`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:16.805513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3ff58865-8a9d-4f6f-bffc-03a9e21c5c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:16.880557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236002a-fa9f-4998-9083-206633c4744b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:16.906892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a45b8-2a69-4f2c-bfa3-0e9ac534f213 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:16.907588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a45b8-2a69-4f2c-bfa3-0e9ac534f213 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:16.907876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a45b8-2a69-4f2c-bfa3-0e9ac534f213 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:16.908185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a45b8-2a69-4f2c-bfa3-0e9ac534f213 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:16.985426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 885/1796] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:16 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:16.986977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9b3c9-e537-4b34-9e16-10b3a277a5c5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:16.988285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9b3c9-e537-4b34-9e16-10b3a277a5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:16.988573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c9b3c9-e537-4b34-9e16-10b3a277a5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:17.052500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-12c9b3c9-e537-4b34-9e16-10b3a277a5c5 None None] MFA Rules not processed for user `539a69a2a5fd47d9b2ab7270954d7132`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:17.053552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-12c9b3c9-e537-4b34-9e16-10b3a277a5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:17.099525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a45b8-2a69-4f2c-bfa3-0e9ac534f213 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:17.102953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a45b8-2a69-4f2c-bfa3-0e9ac534f213 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:17.121740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 912/1797] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:10:17.123318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a45b8-2a69-4f2c-bfa3-0e9ac534f213 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:17.196122 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 886/1798] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:17.206403 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9b3c9-e537-4b34-9e16-10b3a277a5c5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:17.374459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a45b8-2a69-4f2c-bfa3-0e9ac534f213 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:17.382555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17128a-810c-42e0-b783-c960ffad104d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:17.383226 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17128a-810c-42e0-b783-c960ffad104d service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:17.383511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17128a-810c-42e0-b783-c960ffad104d service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:17.386277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17128a-810c-42e0-b783-c960ffad104d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:17.412865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17128a-810c-42e0-b783-c960ffad104d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:17.417609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17128a-810c-42e0-b783-c960ffad104d service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:17.448972 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 913/1799] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:17 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:17.538070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:17.661237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c9b3c9-e537-4b34-9e16-10b3a277a5c5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:17.703971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2414a-295c-40a1-9144-4337d5be195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:17.714176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0f123-aa75-4e7f-af34-464800ead3d4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:17.714471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0f123-aa75-4e7f-af34-464800ead3d4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:17.714754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d0f123-aa75-4e7f-af34-464800ead3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:17.733303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2414a-295c-40a1-9144-4337d5be195c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:17.733303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2414a-295c-40a1-9144-4337d5be195c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:17.733303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2414a-295c-40a1-9144-4337d5be195c admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:17.733765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2414a-295c-40a1-9144-4337d5be195c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:17.736358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2414a-295c-40a1-9144-4337d5be195c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:17.765200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a3d0f123-aa75-4e7f-af34-464800ead3d4 None None] MFA Rules not processed for user `2ad07969d5a043e7b83e403da35120da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:17.769135 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a3d0f123-aa75-4e7f-af34-464800ead3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:17.918899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 887/1800] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:17 2022] POST /identity/v3/projects => generated 381 bytes in 714 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:17.928407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2414a-295c-40a1-9144-4337d5be195c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:18.007127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 914/1801] 10.222.0.87 () {58 vars in 1015 bytes} [Wed Jul 20 22:10:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:18.105752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2414a-295c-40a1-9144-4337d5be195c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:18.136106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429832ba-a826-4770-ab6f-9bcb668fe7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:18.136106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429832ba-a826-4770-ab6f-9bcb668fe7a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:18.136400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429832ba-a826-4770-ab6f-9bcb668fe7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:18.136836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429832ba-a826-4770-ab6f-9bcb668fe7a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:18.137689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429832ba-a826-4770-ab6f-9bcb668fe7a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:18.141630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429832ba-a826-4770-ab6f-9bcb668fe7a6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:18.268822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 888/1802] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:17 2022] POST /identity/v3/users => generated 297 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:18.269583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0f123-aa75-4e7f-af34-464800ead3d4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:18.287127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d0f123-aa75-4e7f-af34-464800ead3d4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:18.309659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a287022-a925-4e1d-b9c8-a7047e75642a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:18.310667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a287022-a925-4e1d-b9c8-a7047e75642a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:18.311951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a287022-a925-4e1d-b9c8-a7047e75642a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:18.312316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a287022-a925-4e1d-b9c8-a7047e75642a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:18.313407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a287022-a925-4e1d-b9c8-a7047e75642a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:18.321443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a287022-a925-4e1d-b9c8-a7047e75642a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:18.348562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 915/1803] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:10:18.352369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429832ba-a826-4770-ab6f-9bcb668fe7a6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:18.370763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429832ba-a826-4770-ab6f-9bcb668fe7a6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:18.390161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0aac5e-4f6a-4397-b3dc-893c9d72c8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:18.391073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aac5e-4f6a-4397-b3dc-893c9d72c8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:18.391349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aac5e-4f6a-4397-b3dc-893c9d72c8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:18.391619 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0aac5e-4f6a-4397-b3dc-893c9d72c8ec admin admin] PATH_INFO: `/v3/projects/2383b5ae9b554c4880c4ba0495aa0226/users/f4755aa57af74f35b078162d751d29b1/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:18.445063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aac5e-4f6a-4397-b3dc-893c9d72c8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=2383b5ae9b554c4880c4ba0495aa0226, user_id=f4755aa57af74f35b078162d751d29b1, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:18.449455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0aac5e-4f6a-4397-b3dc-893c9d72c8ec admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:18.626426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a287022-a925-4e1d-b9c8-a7047e75642a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:18.634498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8a287022-a925-4e1d-b9c8-a7047e75642a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:18.678954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 889/1804] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:18 2022] PUT /identity/v3/projects/2383b5ae9b554c4880c4ba0495aa0226/users/f4755aa57af74f35b078162d751d29b1/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:18.683776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0aac5e-4f6a-4397-b3dc-893c9d72c8ec admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:18.866048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a287022-a925-4e1d-b9c8-a7047e75642a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:18.920404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0aac5e-4f6a-4397-b3dc-893c9d72c8ec admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:18.940630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3d40e-3604-4b31-aa5e-9fd1437f6b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:18.941373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3d40e-3604-4b31-aa5e-9fd1437f6b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:18.941726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3d40e-3604-4b31-aa5e-9fd1437f6b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:18.942005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3d40e-3604-4b31-aa5e-9fd1437f6b80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:18.948594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3d40e-3604-4b31-aa5e-9fd1437f6b80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:18.951200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3d40e-3604-4b31-aa5e-9fd1437f6b80 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:19.009434 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 890/1805] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:19.012238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3d40e-3604-4b31-aa5e-9fd1437f6b80 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:19.071672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3d40e-3604-4b31-aa5e-9fd1437f6b80 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:19.094743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86483ef3-51b7-46f5-b18f-6a71b47aad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:19.098908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2158481-043d-43ac-b253-0fd5fb0fb623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:19.099719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2158481-043d-43ac-b253-0fd5fb0fb623 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:19.104219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86483ef3-51b7-46f5-b18f-6a71b47aad74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:19.104632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2158481-043d-43ac-b253-0fd5fb0fb623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:19.104947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86483ef3-51b7-46f5-b18f-6a71b47aad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:19.105087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2158481-043d-43ac-b253-0fd5fb0fb623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:19.105501 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86483ef3-51b7-46f5-b18f-6a71b47aad74 admin admin] PATH_INFO: `/v3/projects/2383b5ae9b554c4880c4ba0495aa0226/users/f4755aa57af74f35b078162d751d29b1/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:19.110027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86483ef3-51b7-46f5-b18f-6a71b47aad74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2383b5ae9b554c4880c4ba0495aa0226, user_id=f4755aa57af74f35b078162d751d29b1, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:19.117132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86483ef3-51b7-46f5-b18f-6a71b47aad74 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:19.120921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:19.140193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2158481-043d-43ac-b253-0fd5fb0fb623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:19.142053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2158481-043d-43ac-b253-0fd5fb0fb623 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:19.165580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 916/1806] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:19.166754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2158481-043d-43ac-b253-0fd5fb0fb623 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:19.178735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 891/1807] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:19 2022] PUT /identity/v3/projects/2383b5ae9b554c4880c4ba0495aa0226/users/f4755aa57af74f35b078162d751d29b1/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:19.195372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2158481-043d-43ac-b253-0fd5fb0fb623 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:19.203506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78728e1-4f78-4920-a64f-14012b0b233d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:19.203804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78728e1-4f78-4920-a64f-14012b0b233d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:19.204127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78728e1-4f78-4920-a64f-14012b0b233d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:19.314069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b78728e1-4f78-4920-a64f-14012b0b233d None None] MFA Rules not processed for user `f4755aa57af74f35b078162d751d29b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:19.316805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b78728e1-4f78-4920-a64f-14012b0b233d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:19.468681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d1aa-94b6-436e-8235-f470122c620a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:19.468681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d1aa-94b6-436e-8235-f470122c620a service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:19.468681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d1aa-94b6-436e-8235-f470122c620a service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:19.468681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25d1aa-94b6-436e-8235-f470122c620a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:19.469625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25d1aa-94b6-436e-8235-f470122c620a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:19.469625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25d1aa-94b6-436e-8235-f470122c620a service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:19.469625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 917/1808] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:19.563083 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 892/1809] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:19.598271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d1aa-94b6-436e-8235-f470122c620a service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:19.752336 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25d1aa-94b6-436e-8235-f470122c620a service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:19.758341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c710642-c0db-4f52-a218-a183e420c3cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:19.759527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c710642-c0db-4f52-a218-a183e420c3cd service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:19.760058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c710642-c0db-4f52-a218-a183e420c3cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:19.760549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c710642-c0db-4f52-a218-a183e420c3cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:19.885633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c710642-c0db-4f52-a218-a183e420c3cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:19.887484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c710642-c0db-4f52-a218-a183e420c3cd service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:19.901470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 918/1810] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:19.980189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:21.164461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78728e1-4f78-4920-a64f-14012b0b233d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:21.269355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78728e1-4f78-4920-a64f-14012b0b233d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:21.276540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:21.277452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:21.277452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:21.278282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] PATH_INFO: `/v3/users/af2b53c115c04d739d1ef3b7c5936052` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:21.279461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2b53c115c04d739d1ef3b7c5936052)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:21.281994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:21.697596 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2b53c115c04d739d1ef3b7c5936052'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:21.732344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2b53c115c04d739d1ef3b7c5936052'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:21.750529 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2b53c115c04d739d1ef3b7c5936052'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:21.756484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2b53c115c04d739d1ef3b7c5936052'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:21.758359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2b53c115c04d739d1ef3b7c5936052'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:21.868664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 893/1811] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:21 2022] DELETE /identity/v3/users/af2b53c115c04d739d1ef3b7c5936052 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:21.872603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a723-eb03-4907-975d-dd23913bcba6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:21.873182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a723-eb03-4907-975d-dd23913bcba6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:21.873292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61a723-eb03-4907-975d-dd23913bcba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:21.912766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1c61a723-eb03-4907-975d-dd23913bcba6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:21.914856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1c61a723-eb03-4907-975d-dd23913bcba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:22.052361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 919/1812] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:22.197261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:22.197261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:22.249912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:22.302592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a688578-c9e7-4f86-9ae6-357eef5451c0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:22.306641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09d7bf-f7cc-4fd7-8c12-75c05c6c0117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:22.307591 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d7bf-f7cc-4fd7-8c12-75c05c6c0117 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:22.308557 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d7bf-f7cc-4fd7-8c12-75c05c6c0117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:22.308695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09d7bf-f7cc-4fd7-8c12-75c05c6c0117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:22.339018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:22.360857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d7bf-f7cc-4fd7-8c12-75c05c6c0117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:22.362396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09d7bf-f7cc-4fd7-8c12-75c05c6c0117 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:22.383136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 894/1813] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:22.576437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b85e8-0bec-46a1-88a4-67b91fcfaf39 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:22.578956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b85e8-0bec-46a1-88a4-67b91fcfaf39 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:22.585495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553b85e8-0bec-46a1-88a4-67b91fcfaf39 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:22.587686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 920/1814] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:10:22 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:10:22.640795 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bbf99-c042-44eb-80a5-e8d12bf58134 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:22.640986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bbf99-c042-44eb-80a5-e8d12bf58134 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:22.641219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59bbf99-c042-44eb-80a5-e8d12bf58134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:22.703503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d59bbf99-c042-44eb-80a5-e8d12bf58134 None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:22.704797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d59bbf99-c042-44eb-80a5-e8d12bf58134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:22.993022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 895/1815] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:10:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:23.467870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b85e8-0bec-46a1-88a4-67b91fcfaf39 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:23.471219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-553b85e8-0bec-46a1-88a4-67b91fcfaf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:23.518065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553b85e8-0bec-46a1-88a4-67b91fcfaf39 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:23.532720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d84900-1b09-4d58-bf84-ff2d17f188e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:23.533860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d84900-1b09-4d58-bf84-ff2d17f188e1 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:23.534296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d84900-1b09-4d58-bf84-ff2d17f188e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:23.534731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d84900-1b09-4d58-bf84-ff2d17f188e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:23.568198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d84900-1b09-4d58-bf84-ff2d17f188e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:23.570340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d84900-1b09-4d58-bf84-ff2d17f188e1 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:23.610306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 921/1816] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:23.945154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:24.180031 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:25.854700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3d85e-a23c-40c8-b276-9538e03c7238 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:25.855698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3d85e-a23c-40c8-b276-9538e03c7238 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:25.856320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3d85e-a23c-40c8-b276-9538e03c7238 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:25.859025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 896/1817] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:10:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:10:25.924812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2f4f5-dab4-4639-8d10-1561eddc4e89 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:25.925425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2f4f5-dab4-4639-8d10-1561eddc4e89 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:25.925674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2f4f5-dab4-4639-8d10-1561eddc4e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:25.989227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b8b2f4f5-dab4-4639-8d10-1561eddc4e89 None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:25.991668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b8b2f4f5-dab4-4639-8d10-1561eddc4e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:26.012839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3d85e-a23c-40c8-b276-9538e03c7238 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:26.016272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-37c3d85e-a23c-40c8-b276-9538e03c7238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:26.067246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 922/1818] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:10:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:26.083708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3d85e-a23c-40c8-b276-9538e03c7238 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:26.110714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:26.111688 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:26.112139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:26.112489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] PATH_INFO: `/v3/projects/1a373d8631704fd2bf3009113511267f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:26.123133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a373d8631704fd2bf3009113511267f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:26.126052 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:26.339493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a373d8631704fd2bf3009113511267f', 'request_id': 'req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:26.344014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a373d8631704fd2bf3009113511267f', 'request_id': 'req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:26.391024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a373d8631704fd2bf3009113511267f', 'request_id': 'req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:26.413474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] The token cache is being invalidate because project 1a373d8631704fd2bf3009113511267f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:26.413712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:26.415382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:26.421880 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 897/1819] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:26 2022] DELETE /identity/v3/projects/1a373d8631704fd2bf3009113511267f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:26.426243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2f4f5-dab4-4639-8d10-1561eddc4e89 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:26.444039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2f4f5-dab4-4639-8d10-1561eddc4e89 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:26.605758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:26.631718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:26.637107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:26.658132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] PATH_INFO: `/v3/users/37c9b3d5bfaf41ff9e70b97b2a97ed00` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:26.658132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c9b3d5bfaf41ff9e70b97b2a97ed00)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:26.658132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:27.035144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:27.038399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:27.197892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c9b3d5bfaf41ff9e70b97b2a97ed00'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:27.269411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3bc5ba-c26f-4ba2-900e-0a339ad7f6a7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:27.288957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49856925-1420-49c0-a2e2-dc43e537fb57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:27.289911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49856925-1420-49c0-a2e2-dc43e537fb57 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:27.292335 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49856925-1420-49c0-a2e2-dc43e537fb57 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:27.292804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49856925-1420-49c0-a2e2-dc43e537fb57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:27.302632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-49856925-1420-49c0-a2e2-dc43e537fb57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:27.327150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49856925-1420-49c0-a2e2-dc43e537fb57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:27.330837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49856925-1420-49c0-a2e2-dc43e537fb57 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:27.352535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 898/1820] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:10:27.630902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c9b3d5bfaf41ff9e70b97b2a97ed00'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:27.643699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c9b3d5bfaf41ff9e70b97b2a97ed00'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:27.645770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c9b3d5bfaf41ff9e70b97b2a97ed00'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:27.693160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ebae08d9-4b75-4019-8d21-0b134b639c99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c9b3d5bfaf41ff9e70b97b2a97ed00'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:27.720408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 923/1821] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:26 2022] DELETE /identity/v3/users/37c9b3d5bfaf41ff9e70b97b2a97ed00 => generated 0 bytes in 1295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:29.898131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49856925-1420-49c0-a2e2-dc43e537fb57 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:29.900570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-49856925-1420-49c0-a2e2-dc43e537fb57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:29.955605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49856925-1420-49c0-a2e2-dc43e537fb57 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:30.048636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:30.050680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:30.051122 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:30.051609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] PATH_INFO: `/v3/projects/a44d06703dca45edb1d4288b1397beca` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:30.061542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a44d06703dca45edb1d4288b1397beca)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:30.061542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:30.249292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a44d06703dca45edb1d4288b1397beca', 'request_id': 'req-fcbca2d0-9b6a-453e-b42b-b965f2307249'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:30.254900 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a44d06703dca45edb1d4288b1397beca', 'request_id': 'req-fcbca2d0-9b6a-453e-b42b-b965f2307249'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:30.424400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a44d06703dca45edb1d4288b1397beca', 'request_id': 'req-fcbca2d0-9b6a-453e-b42b-b965f2307249'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:30.437066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] The token cache is being invalidate because project a44d06703dca45edb1d4288b1397beca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:30.437361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:30.438081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fcbca2d0-9b6a-453e-b42b-b965f2307249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:30.439788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 899/1822] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:29 2022] DELETE /identity/v3/projects/a44d06703dca45edb1d4288b1397beca => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:30.445378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627d7eb-b98d-4abb-a655-137a16c5aa67 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:30.445965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627d7eb-b98d-4abb-a655-137a16c5aa67 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:30.445965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627d7eb-b98d-4abb-a655-137a16c5aa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:30.465130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a627d7eb-b98d-4abb-a655-137a16c5aa67 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:30.467158 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a627d7eb-b98d-4abb-a655-137a16c5aa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:30.555785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892f091-7b71-48ad-bfb6-7dc1984bc53d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:30.556104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892f091-7b71-48ad-bfb6-7dc1984bc53d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:30.556467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892f091-7b71-48ad-bfb6-7dc1984bc53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:30.556598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 924/1823] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:30.589948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d892f091-7b71-48ad-bfb6-7dc1984bc53d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:30.591212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d892f091-7b71-48ad-bfb6-7dc1984bc53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:30.615202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 900/1824] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:30.619356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:30.622812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627d7eb-b98d-4abb-a655-137a16c5aa67 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:30.634405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627d7eb-b98d-4abb-a655-137a16c5aa67 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:30.639522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88638f2-1dcb-4258-8128-a0ed36a93558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:30.640773 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88638f2-1dcb-4258-8128-a0ed36a93558 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:30.641061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88638f2-1dcb-4258-8128-a0ed36a93558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:30.641340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88638f2-1dcb-4258-8128-a0ed36a93558 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:30.642097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88638f2-1dcb-4258-8128-a0ed36a93558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:30.642405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88638f2-1dcb-4258-8128-a0ed36a93558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:30.644209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88638f2-1dcb-4258-8128-a0ed36a93558 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:30.665526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892f091-7b71-48ad-bfb6-7dc1984bc53d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:30.670682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 925/1825] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:30.676879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892f091-7b71-48ad-bfb6-7dc1984bc53d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:30.682597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838b0f-5809-418b-bd9b-9082b4bdead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:30.685798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838b0f-5809-418b-bd9b-9082b4bdead5 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:30.685798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838b0f-5809-418b-bd9b-9082b4bdead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:30.685798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3838b0f-5809-418b-bd9b-9082b4bdead5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:30.685798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3838b0f-5809-418b-bd9b-9082b4bdead5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:30.687162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3838b0f-5809-418b-bd9b-9082b4bdead5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:30.815090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 901/1826] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:30 2022] POST /identity/v3/projects => generated 381 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:30.822417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88638f2-1dcb-4258-8128-a0ed36a93558 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:30.832900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88638f2-1dcb-4258-8128-a0ed36a93558 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:30.902024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d0aec-cdbf-4e18-a9ee-09b8d70c6033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:30.925536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0aec-cdbf-4e18-a9ee-09b8d70c6033 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:30.925536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0aec-cdbf-4e18-a9ee-09b8d70c6033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:30.925536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0aec-cdbf-4e18-a9ee-09b8d70c6033 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:30.925536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d0aec-cdbf-4e18-a9ee-09b8d70c6033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:30.925536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d0aec-cdbf-4e18-a9ee-09b8d70c6033 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:31.060191 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 926/1827] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:30 2022] POST /identity/v3/users => generated 291 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:31.061617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838b0f-5809-418b-bd9b-9082b4bdead5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:31.071877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3838b0f-5809-418b-bd9b-9082b4bdead5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:31.076660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e2b1c-0854-4458-96db-05adcf60502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:31.077327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e2b1c-0854-4458-96db-05adcf60502d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:31.077609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e2b1c-0854-4458-96db-05adcf60502d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:31.077884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823e2b1c-0854-4458-96db-05adcf60502d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:31.078766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e2b1c-0854-4458-96db-05adcf60502d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:31.080550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823e2b1c-0854-4458-96db-05adcf60502d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:31.098380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 902/1828] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:10:31.101783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d0aec-cdbf-4e18-a9ee-09b8d70c6033 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:31.120844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d0aec-cdbf-4e18-a9ee-09b8d70c6033 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:31.128411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e62bd-4114-4b23-a4bb-c35379382a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:31.128411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e62bd-4114-4b23-a4bb-c35379382a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:31.128411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e62bd-4114-4b23-a4bb-c35379382a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:31.128411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e62bd-4114-4b23-a4bb-c35379382a45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:31.129039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e62bd-4114-4b23-a4bb-c35379382a45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:31.130649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2e62bd-4114-4b23-a4bb-c35379382a45 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:31.145333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 927/1829] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:31.147262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e2b1c-0854-4458-96db-05adcf60502d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:31.149636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e62bd-4114-4b23-a4bb-c35379382a45 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:31.150092 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-823e2b1c-0854-4458-96db-05adcf60502d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:31.162284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e62bd-4114-4b23-a4bb-c35379382a45 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:31.168574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f99b5-4abc-4411-b39d-40335f4991ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:31.169638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f99b5-4abc-4411-b39d-40335f4991ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:31.169973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f99b5-4abc-4411-b39d-40335f4991ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:31.171126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f99b5-4abc-4411-b39d-40335f4991ab admin admin] PATH_INFO: `/v3/projects/c0a455be64534571bd6d7647bb93c508/users/658d678c0e93426cab181c1b8d2e311a/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:31.188964 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f99b5-4abc-4411-b39d-40335f4991ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0a455be64534571bd6d7647bb93c508, user_id=658d678c0e93426cab181c1b8d2e311a, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:31.192020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f99b5-4abc-4411-b39d-40335f4991ab admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:31.232474 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823e2b1c-0854-4458-96db-05adcf60502d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:31.236786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83806a62-586a-4656-ba2f-c8a456735bab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:31.237706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83806a62-586a-4656-ba2f-c8a456735bab service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:31.238063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83806a62-586a-4656-ba2f-c8a456735bab service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:31.238455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83806a62-586a-4656-ba2f-c8a456735bab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:31.240642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-83806a62-586a-4656-ba2f-c8a456735bab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:31.310693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83806a62-586a-4656-ba2f-c8a456735bab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:31.312155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83806a62-586a-4656-ba2f-c8a456735bab service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:31.322630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 903/1830] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:31.337801 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 928/1831] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:31 2022] PUT /identity/v3/projects/c0a455be64534571bd6d7647bb93c508/users/658d678c0e93426cab181c1b8d2e311a/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:31.345940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc55496-1e4d-4879-b64e-50ebfd18d80c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:31.345940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc55496-1e4d-4879-b64e-50ebfd18d80c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:31.345940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc55496-1e4d-4879-b64e-50ebfd18d80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:31.378625 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2bc55496-1e4d-4879-b64e-50ebfd18d80c None None] MFA Rules not processed for user `658d678c0e93426cab181c1b8d2e311a`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:31.379871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2bc55496-1e4d-4879-b64e-50ebfd18d80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:31.450747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 904/1832] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:31.455895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f99b5-4abc-4411-b39d-40335f4991ab admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:31.519991 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f99b5-4abc-4411-b39d-40335f4991ab admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:31.524935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd8dd4-c8b3-46ca-a1d7-2545f171058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:31.525593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd8dd4-c8b3-46ca-a1d7-2545f171058f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:31.525882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd8dd4-c8b3-46ca-a1d7-2545f171058f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:31.526161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bd8dd4-c8b3-46ca-a1d7-2545f171058f admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:31.526861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd8dd4-c8b3-46ca-a1d7-2545f171058f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:31.528805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bd8dd4-c8b3-46ca-a1d7-2545f171058f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:31.644037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 929/1833] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:31 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:31.648135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc55496-1e4d-4879-b64e-50ebfd18d80c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:31.659437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc55496-1e4d-4879-b64e-50ebfd18d80c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:31.737749 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8d58c-6252-4eef-a8ec-ae23006856f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:31.738449 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8d58c-6252-4eef-a8ec-ae23006856f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:31.738710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8d58c-6252-4eef-a8ec-ae23006856f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:31.738979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8d58c-6252-4eef-a8ec-ae23006856f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:31.739686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8d58c-6252-4eef-a8ec-ae23006856f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:31.741698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e8d58c-6252-4eef-a8ec-ae23006856f0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:31.928115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 905/1834] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:31 2022] POST /identity/v3/users => generated 298 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:10:31.929322 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd8dd4-c8b3-46ca-a1d7-2545f171058f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:31.951461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bd8dd4-c8b3-46ca-a1d7-2545f171058f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:31.960180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e38e9-7e00-4d7b-81b5-64dc72258ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:31.960180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e38e9-7e00-4d7b-81b5-64dc72258ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:31.960180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e38e9-7e00-4d7b-81b5-64dc72258ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:31.960180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381e38e9-7e00-4d7b-81b5-64dc72258ea9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:31.960495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e38e9-7e00-4d7b-81b5-64dc72258ea9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:31.961885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381e38e9-7e00-4d7b-81b5-64dc72258ea9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:31.974842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 930/1835] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:31.983777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8d58c-6252-4eef-a8ec-ae23006856f0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:31.994776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e8d58c-6252-4eef-a8ec-ae23006856f0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:32.000630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08aa515-a4fe-4932-aa81-ede9442aa32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:32.001689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aa515-a4fe-4932-aa81-ede9442aa32c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:32.002482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aa515-a4fe-4932-aa81-ede9442aa32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:32.002482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08aa515-a4fe-4932-aa81-ede9442aa32c admin admin] PATH_INFO: `/v3/projects/45bdddae49fe4ce899508543261f3ad5/users/5427ec8e360d41f980f7c8d7c55933b9/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:32.022652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08aa515-a4fe-4932-aa81-ede9442aa32c admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bdddae49fe4ce899508543261f3ad5, user_id=5427ec8e360d41f980f7c8d7c55933b9, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:32.025537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08aa515-a4fe-4932-aa81-ede9442aa32c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:32.100011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 906/1836] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:31 2022] PUT /identity/v3/projects/45bdddae49fe4ce899508543261f3ad5/users/5427ec8e360d41f980f7c8d7c55933b9/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:32.104991 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e38e9-7e00-4d7b-81b5-64dc72258ea9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:32.119337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381e38e9-7e00-4d7b-81b5-64dc72258ea9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:32.201526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc1d01-0b63-484d-a14b-2c6073dfbf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:32.202210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1d01-0b63-484d-a14b-2c6073dfbf03 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:32.202696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1d01-0b63-484d-a14b-2c6073dfbf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:32.203024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc1d01-0b63-484d-a14b-2c6073dfbf03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:32.203843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc1d01-0b63-484d-a14b-2c6073dfbf03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:32.206063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fc1d01-0b63-484d-a14b-2c6073dfbf03 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:32.217531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 931/1837] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:32.228871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08aa515-a4fe-4932-aa81-ede9442aa32c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:32.238979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:32.243944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08aa515-a4fe-4932-aa81-ede9442aa32c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:32.250108 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4b2d2-1438-4706-a8b0-65ce7b840a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:32.251036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4b2d2-1438-4706-a8b0-65ce7b840a14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:32.251320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4b2d2-1438-4706-a8b0-65ce7b840a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:32.251599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4b2d2-1438-4706-a8b0-65ce7b840a14 admin admin] PATH_INFO: `/v3/projects/45bdddae49fe4ce899508543261f3ad5/users/5427ec8e360d41f980f7c8d7c55933b9/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:32.253614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4b2d2-1438-4706-a8b0-65ce7b840a14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bdddae49fe4ce899508543261f3ad5, user_id=5427ec8e360d41f980f7c8d7c55933b9, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:32.256323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4b2d2-1438-4706-a8b0-65ce7b840a14 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:32.267382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 907/1838] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:32 2022] PUT /identity/v3/projects/45bdddae49fe4ce899508543261f3ad5/users/5427ec8e360d41f980f7c8d7c55933b9/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:32.280091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92e0d1-1bf9-45fa-8c2b-8edb266c4089 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:32.288442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92e0d1-1bf9-45fa-8c2b-8edb266c4089 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:32.288442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b92e0d1-1bf9-45fa-8c2b-8edb266c4089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:32.308990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6b92e0d1-1bf9-45fa-8c2b-8edb266c4089 None None] MFA Rules not processed for user `5427ec8e360d41f980f7c8d7c55933b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:32.310193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6b92e0d1-1bf9-45fa-8c2b-8edb266c4089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:32.380458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 932/1839] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:32.391561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4b2d2-1438-4706-a8b0-65ce7b840a14 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:32.479408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4b2d2-1438-4706-a8b0-65ce7b840a14 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:32.484061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47352d9-92e4-4f1b-9e4b-be069cbc1754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:32.484965 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47352d9-92e4-4f1b-9e4b-be069cbc1754 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:32.485254 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47352d9-92e4-4f1b-9e4b-be069cbc1754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:32.485553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47352d9-92e4-4f1b-9e4b-be069cbc1754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:32.496288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47352d9-92e4-4f1b-9e4b-be069cbc1754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:32.497887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47352d9-92e4-4f1b-9e4b-be069cbc1754 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:32.510673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 908/1840] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:32.619366 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92e0d1-1bf9-45fa-8c2b-8edb266c4089 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:32.629778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b92e0d1-1bf9-45fa-8c2b-8edb266c4089 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:32.633620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a698b1c-2a60-40a9-93a5-3a29318533a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:32.634469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698b1c-2a60-40a9-93a5-3a29318533a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:32.634831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698b1c-2a60-40a9-93a5-3a29318533a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:32.635118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698b1c-2a60-40a9-93a5-3a29318533a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:32.699393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a698b1c-2a60-40a9-93a5-3a29318533a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:32.700787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a698b1c-2a60-40a9-93a5-3a29318533a8 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:32.711046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 933/1841] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:33.335125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47352d9-92e4-4f1b-9e4b-be069cbc1754 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:33.337165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d47352d9-92e4-4f1b-9e4b-be069cbc1754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:33.479203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47352d9-92e4-4f1b-9e4b-be069cbc1754 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:33.490413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:33.491366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:33.491888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:33.492109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] PATH_INFO: `/v3/users/bc31aa4fb4a64718ac87b4ca22324a9d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:33.493493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc31aa4fb4a64718ac87b4ca22324a9d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:33.495673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:33.719722 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc31aa4fb4a64718ac87b4ca22324a9d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:33.735440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc31aa4fb4a64718ac87b4ca22324a9d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:33.745775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc31aa4fb4a64718ac87b4ca22324a9d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:33.746770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc31aa4fb4a64718ac87b4ca22324a9d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:33.747481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc31aa4fb4a64718ac87b4ca22324a9d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:33.841404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973bf57-ffb9-4842-ab97-566f2bccd820 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:33.843036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973bf57-ffb9-4842-ab97-566f2bccd820 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:33.843572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973bf57-ffb9-4842-ab97-566f2bccd820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:33.845952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 909/1842] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:33 2022] DELETE /identity/v3/users/bc31aa4fb4a64718ac87b4ca22324a9d => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:33.867155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4973bf57-ffb9-4842-ab97-566f2bccd820 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:33.868563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4973bf57-ffb9-4842-ab97-566f2bccd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:33.985543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 934/1843] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:34.005271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:34.008676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:34.104055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791bd512-cedd-4e38-8850-706b095669b3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:34.113081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3b95-bb58-4383-8c1d-5f1bb4503195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:34.114029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3b95-bb58-4383-8c1d-5f1bb4503195 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:34.114344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3b95-bb58-4383-8c1d-5f1bb4503195 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:34.114903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72be3b95-bb58-4383-8c1d-5f1bb4503195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:34.130564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be3b95-bb58-4383-8c1d-5f1bb4503195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:34.132383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72be3b95-bb58-4383-8c1d-5f1bb4503195 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:34.143354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:34.162491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 910/1844] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:35.383075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973bf57-ffb9-4842-ab97-566f2bccd820 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:35.385198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4973bf57-ffb9-4842-ab97-566f2bccd820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:35.407050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973bf57-ffb9-4842-ab97-566f2bccd820 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:35.414650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:35.416728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:35.416728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:35.416728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] PATH_INFO: `/v3/projects/46972fd7bd6d4d1a9bd7d5b2224bb478` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:35.417902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46972fd7bd6d4d1a9bd7d5b2224bb478)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:35.419902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:35.633807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46972fd7bd6d4d1a9bd7d5b2224bb478', 'request_id': 'req-b0985bef-c161-44df-9e79-97c2cb4026b7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:35.643954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46972fd7bd6d4d1a9bd7d5b2224bb478', 'request_id': 'req-b0985bef-c161-44df-9e79-97c2cb4026b7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:35.761058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46972fd7bd6d4d1a9bd7d5b2224bb478', 'request_id': 'req-b0985bef-c161-44df-9e79-97c2cb4026b7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:35.774340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] The token cache is being invalidate because project 46972fd7bd6d4d1a9bd7d5b2224bb478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:35.774626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:35.775285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b0985bef-c161-44df-9e79-97c2cb4026b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:35.776869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 935/1845] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:35 2022] DELETE /identity/v3/projects/46972fd7bd6d4d1a9bd7d5b2224bb478 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:35.781306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3b95-bb58-4383-8c1d-5f1bb4503195 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:35.791412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72be3b95-bb58-4383-8c1d-5f1bb4503195 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:35.856378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:35.857897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:35.858144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:35.858423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] PATH_INFO: `/v3/users/e64d98d0d72f46bcb22b96624998f4a1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:35.859676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64d98d0d72f46bcb22b96624998f4a1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:35.861672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:35.862436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f558fb3-b7d6-4218-9246-d095af646f5e None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:35.862814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f558fb3-b7d6-4218-9246-d095af646f5e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:35.863173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f558fb3-b7d6-4218-9246-d095af646f5e None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:35.867019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 936/1846] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:10:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:10:35.908495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f801-8fa4-4728-91e2-3f84b7128d4d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:35.908778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f801-8fa4-4728-91e2-3f84b7128d4d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:35.909133 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f801-8fa4-4728-91e2-3f84b7128d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:35.949215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f718f801-8fa4-4728-91e2-3f84b7128d4d None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:35.949215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f718f801-8fa4-4728-91e2-3f84b7128d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:36.021578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 937/1847] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:10:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:36.022435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718f801-8fa4-4728-91e2-3f84b7128d4d None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:36.023710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f718f801-8fa4-4728-91e2-3f84b7128d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:36.038047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718f801-8fa4-4728-91e2-3f84b7128d4d None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:36.048063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:36.048063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:36.048063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:36.048063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] PATH_INFO: `/v3/users/658d678c0e93426cab181c1b8d2e311a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:36.048587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=658d678c0e93426cab181c1b8d2e311a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:36.048660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:36.256760 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64d98d0d72f46bcb22b96624998f4a1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:36.272299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64d98d0d72f46bcb22b96624998f4a1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:36.284297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64d98d0d72f46bcb22b96624998f4a1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:36.284448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64d98d0d72f46bcb22b96624998f4a1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:36.285013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64d98d0d72f46bcb22b96624998f4a1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:36.335095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '658d678c0e93426cab181c1b8d2e311a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:36.364850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 911/1848] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:35 2022] DELETE /identity/v3/users/e64d98d0d72f46bcb22b96624998f4a1 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:36.364850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:36.364850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:36.499069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '658d678c0e93426cab181c1b8d2e311a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:36.509318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '658d678c0e93426cab181c1b8d2e311a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:36.509724 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f0522a-0164-47a0-b59e-7026d360e98d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:36.510047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '658d678c0e93426cab181c1b8d2e311a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:36.517610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63a6ec-73f1-4a3a-bccd-3997d33d16e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:36.518666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a6ec-73f1-4a3a-bccd-3997d33d16e7 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:36.519098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a6ec-73f1-4a3a-bccd-3997d33d16e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:36.519442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63a6ec-73f1-4a3a-bccd-3997d33d16e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:36.522675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:36.524995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7a63a6ec-73f1-4a3a-bccd-3997d33d16e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:36.526980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4c33bf8d-2717-4ab6-a86c-97a4b5e3fd2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '658d678c0e93426cab181c1b8d2e311a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:36.534624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 938/1849] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:36 2022] DELETE /identity/v3/users/658d678c0e93426cab181c1b8d2e311a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:36.539579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8a8af-6230-458c-b708-7b8afc0137c6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:36.539872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8a8af-6230-458c-b708-7b8afc0137c6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:36.540182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d8a8af-6230-458c-b708-7b8afc0137c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:36.556810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63a6ec-73f1-4a3a-bccd-3997d33d16e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:36.558860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63a6ec-73f1-4a3a-bccd-3997d33d16e7 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:36.562997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d6d8a8af-6230-458c-b708-7b8afc0137c6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:36.564311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d6d8a8af-6230-458c-b708-7b8afc0137c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:36.573653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 912/1850] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:36.657645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 939/1851] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:36.668980 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63a6ec-73f1-4a3a-bccd-3997d33d16e7 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:36.670999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7a63a6ec-73f1-4a3a-bccd-3997d33d16e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:36.781323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63a6ec-73f1-4a3a-bccd-3997d33d16e7 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:36.845777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcb8ec6-aec5-48c8-a5a9-4f00f6318dd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:36.846494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb8ec6-aec5-48c8-a5a9-4f00f6318dd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:36.846776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb8ec6-aec5-48c8-a5a9-4f00f6318dd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:36.847067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcb8ec6-aec5-48c8-a5a9-4f00f6318dd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:36.858110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb8ec6-aec5-48c8-a5a9-4f00f6318dd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:36.860156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcb8ec6-aec5-48c8-a5a9-4f00f6318dd6 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:36.876555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 913/1852] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:36.972525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:37.027102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8a8af-6230-458c-b708-7b8afc0137c6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:37.030761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d6d8a8af-6230-458c-b708-7b8afc0137c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:37.049918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d8a8af-6230-458c-b708-7b8afc0137c6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:37.057382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:37.058962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:37.059572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:37.060099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] PATH_INFO: `/v3/projects/1c1e378f18e043aa95d486c18ec756df` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:37.062971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c1e378f18e043aa95d486c18ec756df)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:37.066755 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:37.269053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c1e378f18e043aa95d486c18ec756df', 'request_id': 'req-8329738a-e10c-4f30-820b-fcde3d1e22e4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:37.275481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c1e378f18e043aa95d486c18ec756df', 'request_id': 'req-8329738a-e10c-4f30-820b-fcde3d1e22e4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:37.380357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c1e378f18e043aa95d486c18ec756df', 'request_id': 'req-8329738a-e10c-4f30-820b-fcde3d1e22e4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:37.406675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] The token cache is being invalidate because project 1c1e378f18e043aa95d486c18ec756df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:37.407001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:37.407732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8329738a-e10c-4f30-820b-fcde3d1e22e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:37.416095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbb6ba-feb5-4259-9930-5f030b7577f9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:37.416095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbb6ba-feb5-4259-9930-5f030b7577f9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:37.416533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbb6ba-feb5-4259-9930-5f030b7577f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:37.418840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 940/1853] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:37 2022] DELETE /identity/v3/projects/1c1e378f18e043aa95d486c18ec756df => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:37.439326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bdcbb6ba-feb5-4259-9930-5f030b7577f9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:37.452237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bdcbb6ba-feb5-4259-9930-5f030b7577f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:37.595818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a989-51fa-40dc-8335-626d88fa3204 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:37.596867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a989-51fa-40dc-8335-626d88fa3204 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:37.597511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4a989-51fa-40dc-8335-626d88fa3204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:37.615786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 914/1854] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:37.655747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-66c4a989-51fa-40dc-8335-626d88fa3204 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:37.657957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-66c4a989-51fa-40dc-8335-626d88fa3204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:37.687935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 941/1855] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:37.691996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbb6ba-feb5-4259-9930-5f030b7577f9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:37.717969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbb6ba-feb5-4259-9930-5f030b7577f9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:37.728656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930ddd3-e1f8-4c6c-afc4-10045df6813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:37.729633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930ddd3-e1f8-4c6c-afc4-10045df6813e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:37.729999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930ddd3-e1f8-4c6c-afc4-10045df6813e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:37.730349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930ddd3-e1f8-4c6c-afc4-10045df6813e admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:37.732037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930ddd3-e1f8-4c6c-afc4-10045df6813e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:37.733239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930ddd3-e1f8-4c6c-afc4-10045df6813e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:37.735821 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930ddd3-e1f8-4c6c-afc4-10045df6813e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:37.762779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4a989-51fa-40dc-8335-626d88fa3204 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:37.764377 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 915/1856] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:37.765942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930ddd3-e1f8-4c6c-afc4-10045df6813e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:37.769997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1930ddd3-e1f8-4c6c-afc4-10045df6813e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:37.787800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4a989-51fa-40dc-8335-626d88fa3204 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:37.799183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930ddd3-e1f8-4c6c-afc4-10045df6813e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:37.800681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:37.803202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:37.803498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:37.803782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] PATH_INFO: `/v3/users/539a69a2a5fd47d9b2ab7270954d7132` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:37.805721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4d89c-61d7-4fd1-807b-352c8837172b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:37.806516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4d89c-61d7-4fd1-807b-352c8837172b admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:37.807323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4d89c-61d7-4fd1-807b-352c8837172b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:37.807604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4d89c-61d7-4fd1-807b-352c8837172b admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:37.809566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=539a69a2a5fd47d9b2ab7270954d7132)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:37.810196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4d89c-61d7-4fd1-807b-352c8837172b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:37.813481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca4d89c-61d7-4fd1-807b-352c8837172b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:37.817309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:37.954171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 942/1857] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:37 2022] POST /identity/v3/projects => generated 379 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:10:37.955542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4d89c-61d7-4fd1-807b-352c8837172b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:37.958287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7ca4d89c-61d7-4fd1-807b-352c8837172b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:38.028383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4d89c-61d7-4fd1-807b-352c8837172b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:38.034316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:38.035190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:38.035475 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:38.035779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] PATH_INFO: `/v3/projects/c0a455be64534571bd6d7647bb93c508` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:38.037335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0a455be64534571bd6d7647bb93c508)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:38.039379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:38.049620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539a69a2a5fd47d9b2ab7270954d7132'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.067772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539a69a2a5fd47d9b2ab7270954d7132'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.078591 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539a69a2a5fd47d9b2ab7270954d7132'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.085792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539a69a2a5fd47d9b2ab7270954d7132'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.085792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539a69a2a5fd47d9b2ab7270954d7132'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.233430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0a455be64534571bd6d7647bb93c508', 'request_id': 'req-4cf9737f-5d46-4210-8a43-621a8ebc81bd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.239354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0a455be64534571bd6d7647bb93c508', 'request_id': 'req-4cf9737f-5d46-4210-8a43-621a8ebc81bd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.265374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 916/1858] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:37 2022] DELETE /identity/v3/users/539a69a2a5fd47d9b2ab7270954d7132 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:38.266388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:38.267975 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:38.339272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0a455be64534571bd6d7647bb93c508', 'request_id': 'req-4cf9737f-5d46-4210-8a43-621a8ebc81bd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.342457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0730b04-d36b-48f3-bc41-93a56ae426fa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:38.348244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c28938-e76d-4cc5-b077-12763f0d6460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:38.349067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28938-e76d-4cc5-b077-12763f0d6460 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:38.349567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28938-e76d-4cc5-b077-12763f0d6460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:38.349895 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c28938-e76d-4cc5-b077-12763f0d6460 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:38.350306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c28938-e76d-4cc5-b077-12763f0d6460 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:38.352817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c28938-e76d-4cc5-b077-12763f0d6460 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:38.379195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] The token cache is being invalidate because project c0a455be64534571bd6d7647bb93c508 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:38.379805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.380391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4cf9737f-5d46-4210-8a43-621a8ebc81bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.381984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 943/1859] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:37 2022] DELETE /identity/v3/projects/c0a455be64534571bd6d7647bb93c508 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:38.383539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b597f-5382-4604-83c7-8a2cb0b6283c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:38.383794 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b597f-5382-4604-83c7-8a2cb0b6283c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:38.384129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b597f-5382-4604-83c7-8a2cb0b6283c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:38.406115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-116b597f-5382-4604-83c7-8a2cb0b6283c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:38.407315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-116b597f-5382-4604-83c7-8a2cb0b6283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:38.415130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 944/1860] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:38.415886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b597f-5382-4604-83c7-8a2cb0b6283c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:38.417178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-116b597f-5382-4604-83c7-8a2cb0b6283c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:38.429550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b597f-5382-4604-83c7-8a2cb0b6283c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:38.434279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:38.435275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:38.435577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:38.435853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] PATH_INFO: `/v3/users/5427ec8e360d41f980f7c8d7c55933b9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:38.439181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5427ec8e360d41f980f7c8d7c55933b9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:38.441272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:38.465570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 917/1861] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:38 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:38.467227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c28938-e76d-4cc5-b077-12763f0d6460 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:38.470286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-22c28938-e76d-4cc5-b077-12763f0d6460 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:38.528266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c28938-e76d-4cc5-b077-12763f0d6460 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:38.532921 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6128065-970d-48da-b385-65ddf21058b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:38.533609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6128065-970d-48da-b385-65ddf21058b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:38.533895 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6128065-970d-48da-b385-65ddf21058b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:38.534173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6128065-970d-48da-b385-65ddf21058b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:38.544378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6128065-970d-48da-b385-65ddf21058b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:38.546653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6128065-970d-48da-b385-65ddf21058b0 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:38.556925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 918/1862] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:38.560602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6128065-970d-48da-b385-65ddf21058b0 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:38.560602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f6128065-970d-48da-b385-65ddf21058b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:38.572452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6128065-970d-48da-b385-65ddf21058b0 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:38.579152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e48e4-93d0-4ec7-98c3-4d9850c15637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:38.579858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e48e4-93d0-4ec7-98c3-4d9850c15637 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:38.580173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e48e4-93d0-4ec7-98c3-4d9850c15637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:38.580447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e48e4-93d0-4ec7-98c3-4d9850c15637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:38.581233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e48e4-93d0-4ec7-98c3-4d9850c15637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:38.582980 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e48e4-93d0-4ec7-98c3-4d9850c15637 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:38.594008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 919/1863] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:38.598124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e48e4-93d0-4ec7-98c3-4d9850c15637 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:38.609418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e48e4-93d0-4ec7-98c3-4d9850c15637 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:38.614526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d800212-f497-4841-8c37-30029b1b46e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:38.617944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800212-f497-4841-8c37-30029b1b46e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:38.617944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800212-f497-4841-8c37-30029b1b46e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:38.617944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d800212-f497-4841-8c37-30029b1b46e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:38.617944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d800212-f497-4841-8c37-30029b1b46e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:38.618352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d800212-f497-4841-8c37-30029b1b46e1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:38.627076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:38.629584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 920/1864] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:10:38.633549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d800212-f497-4841-8c37-30029b1b46e1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:38.634903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5427ec8e360d41f980f7c8d7c55933b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.644941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d800212-f497-4841-8c37-30029b1b46e1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:38.649666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37dc35-5c97-4e56-9ab2-05ed2cc4b072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:38.650663 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37dc35-5c97-4e56-9ab2-05ed2cc4b072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:38.650850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37dc35-5c97-4e56-9ab2-05ed2cc4b072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:38.651126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37dc35-5c97-4e56-9ab2-05ed2cc4b072 admin admin] PATH_INFO: `/v3/projects/e1f8ba2e0d5948499376ab56b44343d7/users/b859da7e34ef49419b26e8899a773be1/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:38.668134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37dc35-5c97-4e56-9ab2-05ed2cc4b072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1f8ba2e0d5948499376ab56b44343d7, user_id=b859da7e34ef49419b26e8899a773be1, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:38.672062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad37dc35-5c97-4e56-9ab2-05ed2cc4b072 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:38.721258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5427ec8e360d41f980f7c8d7c55933b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.729245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5427ec8e360d41f980f7c8d7c55933b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.729994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5427ec8e360d41f980f7c8d7c55933b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.747370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7744d52c-5423-429a-8fc6-5caf4118d973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5427ec8e360d41f980f7c8d7c55933b9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:38.765727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 945/1865] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:38 2022] DELETE /identity/v3/users/5427ec8e360d41f980f7c8d7c55933b9 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:38.777911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 921/1866] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:38 2022] PUT /identity/v3/projects/e1f8ba2e0d5948499376ab56b44343d7/users/b859da7e34ef49419b26e8899a773be1/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:38.779348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfda597-86f5-4122-bb64-e5f4880b6167 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:38.780488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfda597-86f5-4122-bb64-e5f4880b6167 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:38.781318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfda597-86f5-4122-bb64-e5f4880b6167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:38.816719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2cfda597-86f5-4122-bb64-e5f4880b6167 None None] MFA Rules not processed for user `b859da7e34ef49419b26e8899a773be1`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:38.818272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2cfda597-86f5-4122-bb64-e5f4880b6167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:38.929412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 946/1867] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:38.934136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37dc35-5c97-4e56-9ab2-05ed2cc4b072 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:38.936710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ad37dc35-5c97-4e56-9ab2-05ed2cc4b072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:38.940533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:39.030720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad37dc35-5c97-4e56-9ab2-05ed2cc4b072 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:39.102914 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdbaf7-fb9d-46fd-9654-0f3f1670f209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:39.103690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdbaf7-fb9d-46fd-9654-0f3f1670f209 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:39.103998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdbaf7-fb9d-46fd-9654-0f3f1670f209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:39.104588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdbaf7-fb9d-46fd-9654-0f3f1670f209 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:39.105292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdbaf7-fb9d-46fd-9654-0f3f1670f209 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:39.107633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafdbaf7-fb9d-46fd-9654-0f3f1670f209 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:39.250006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 922/1868] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:38 2022] POST /identity/v3/projects => generated 377 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:39.260226 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfda597-86f5-4122-bb64-e5f4880b6167 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:39.282188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdbaf7-fb9d-46fd-9654-0f3f1670f209 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:39.282860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfda597-86f5-4122-bb64-e5f4880b6167 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:39.286193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cafdbaf7-fb9d-46fd-9654-0f3f1670f209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:39.374386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c4430-ae16-4b33-af5a-0132aad5fa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:39.376104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c4430-ae16-4b33-af5a-0132aad5fa46 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:39.376104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c4430-ae16-4b33-af5a-0132aad5fa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:39.376104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c4430-ae16-4b33-af5a-0132aad5fa46 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:39.376519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c4430-ae16-4b33-af5a-0132aad5fa46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:39.379491 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5c4430-ae16-4b33-af5a-0132aad5fa46 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:39.406506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdbaf7-fb9d-46fd-9654-0f3f1670f209 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:39.417654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:39.418551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:39.421276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:39.421276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] PATH_INFO: `/v3/projects/c35263a53f8d4f2fae296e81af20cf11` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:39.421497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c35263a53f8d4f2fae296e81af20cf11)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:39.424978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:39.487864 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 947/1869] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:39 2022] POST /identity/v3/users => generated 295 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:39.491848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c4430-ae16-4b33-af5a-0132aad5fa46 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:39.503151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5c4430-ae16-4b33-af5a-0132aad5fa46 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:39.508160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919bdd4-6193-437b-9b5e-4d6b9e8bbc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:39.508822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919bdd4-6193-437b-9b5e-4d6b9e8bbc28 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:39.509107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919bdd4-6193-437b-9b5e-4d6b9e8bbc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:39.509414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919bdd4-6193-437b-9b5e-4d6b9e8bbc28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:39.510103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919bdd4-6193-437b-9b5e-4d6b9e8bbc28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:39.512406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1919bdd4-6193-437b-9b5e-4d6b9e8bbc28 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:39.524703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 948/1870] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:10:39.529453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919bdd4-6193-437b-9b5e-4d6b9e8bbc28 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:39.573076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1919bdd4-6193-437b-9b5e-4d6b9e8bbc28 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:39.593002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782b82-13b9-4f3f-b587-f51c393bdc78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:39.594767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782b82-13b9-4f3f-b587-f51c393bdc78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:39.596655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782b82-13b9-4f3f-b587-f51c393bdc78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:39.597213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02782b82-13b9-4f3f-b587-f51c393bdc78 admin admin] PATH_INFO: `/v3/projects/015b0899f3d444518c85c2f8736bcc70/users/0b98694efb1b496c9dfb794671912f64/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:39.638795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02782b82-13b9-4f3f-b587-f51c393bdc78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015b0899f3d444518c85c2f8736bcc70, user_id=0b98694efb1b496c9dfb794671912f64, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:39.642693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02782b82-13b9-4f3f-b587-f51c393bdc78 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:39.662446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c35263a53f8d4f2fae296e81af20cf11', 'request_id': 'req-026a2a4b-c566-4059-9880-da4b1d13be73'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:39.671580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c35263a53f8d4f2fae296e81af20cf11', 'request_id': 'req-026a2a4b-c566-4059-9880-da4b1d13be73'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:39.775545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 949/1871] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:39 2022] PUT /identity/v3/projects/015b0899f3d444518c85c2f8736bcc70/users/0b98694efb1b496c9dfb794671912f64/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:39.777320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782b82-13b9-4f3f-b587-f51c393bdc78 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:39.782040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-02782b82-13b9-4f3f-b587-f51c393bdc78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:39.794746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c35263a53f8d4f2fae296e81af20cf11', 'request_id': 'req-026a2a4b-c566-4059-9880-da4b1d13be73'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:39.816205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] The token cache is being invalidate because project c35263a53f8d4f2fae296e81af20cf11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:39.816737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:39.818709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:39.821733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 923/1872] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:39 2022] DELETE /identity/v3/projects/c35263a53f8d4f2fae296e81af20cf11 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:39.822747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:39.825837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:39.892510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02782b82-13b9-4f3f-b587-f51c393bdc78 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:39.902397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:39.903310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:39.903599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:39.903875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] PATH_INFO: `/v3/projects/45bdddae49fe4ce899508543261f3ad5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:39.906449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45bdddae49fe4ce899508543261f3ad5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:39.908445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:39.921149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a2a4b-c566-4059-9880-da4b1d13be73 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:39.926095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad8071-9c11-4483-93a4-7f825369785e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:39.926785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8071-9c11-4483-93a4-7f825369785e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:39.927066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8071-9c11-4483-93a4-7f825369785e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:39.927348 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad8071-9c11-4483-93a4-7f825369785e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:39.928161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad8071-9c11-4483-93a4-7f825369785e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:39.929826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad8071-9c11-4483-93a4-7f825369785e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:39.944344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 924/1873] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:39.944344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad8071-9c11-4483-93a4-7f825369785e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:39.944344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d3ad8071-9c11-4483-93a4-7f825369785e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:39.960772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad8071-9c11-4483-93a4-7f825369785e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:39.964844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:39.965833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:39.966058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:39.966570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] PATH_INFO: `/v3/users/f4755aa57af74f35b078162d751d29b1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:39.969192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4755aa57af74f35b078162d751d29b1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:39.971849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:40.078671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45bdddae49fe4ce899508543261f3ad5', 'request_id': 'req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:40.086184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45bdddae49fe4ce899508543261f3ad5', 'request_id': 'req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:40.149942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:40.182925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45bdddae49fe4ce899508543261f3ad5', 'request_id': 'req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:40.198337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] The token cache is being invalidate because project 45bdddae49fe4ce899508543261f3ad5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:40.198659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:40.204372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4755aa57af74f35b078162d751d29b1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:40.211397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:40.216490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 950/1874] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:39 2022] DELETE /identity/v3/projects/45bdddae49fe4ce899508543261f3ad5 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:40.216490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:40.218960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:40.221269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4755aa57af74f35b078162d751d29b1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:40.230787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4755aa57af74f35b078162d751d29b1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:40.231589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4755aa57af74f35b078162d751d29b1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:40.232432 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ff0fb171-850e-4c7f-a97e-75a14bec1a42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4755aa57af74f35b078162d751d29b1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:40.320716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53307d-20ed-4678-81a6-bb5e8c7e9f41 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:40.334246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 925/1875] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:39 2022] DELETE /identity/v3/users/f4755aa57af74f35b078162d751d29b1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:40.335867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0920-29c9-4416-baed-c28291b29ef1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:40.336618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0920-29c9-4416-baed-c28291b29ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:40.337194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f0920-29c9-4416-baed-c28291b29ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:40.340219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dadab4-5f2c-41dc-a8cc-b3c1f647666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:40.341749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dadab4-5f2c-41dc-a8cc-b3c1f647666a admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:40.344957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dadab4-5f2c-41dc-a8cc-b3c1f647666a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:40.345845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dadab4-5f2c-41dc-a8cc-b3c1f647666a admin admin] PATH_INFO: `/v3/projects/015b0899f3d444518c85c2f8736bcc70/users/0b98694efb1b496c9dfb794671912f64/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:40.352917 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dadab4-5f2c-41dc-a8cc-b3c1f647666a admin admin] RBAC: Authorizing `identity:create_grant(project_id=015b0899f3d444518c85c2f8736bcc70, user_id=0b98694efb1b496c9dfb794671912f64, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:40.362896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dadab4-5f2c-41dc-a8cc-b3c1f647666a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:40.372778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dd1f0920-29c9-4416-baed-c28291b29ef1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:40.374906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dd1f0920-29c9-4416-baed-c28291b29ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:40.395168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 951/1876] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:40 2022] PUT /identity/v3/projects/015b0899f3d444518c85c2f8736bcc70/users/0b98694efb1b496c9dfb794671912f64/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:40.427495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246353-f4f4-4530-8bd0-786e14e40210 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:40.427495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246353-f4f4-4530-8bd0-786e14e40210 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:40.427495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b246353-f4f4-4530-8bd0-786e14e40210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:40.478480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:40.487604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3b246353-f4f4-4530-8bd0-786e14e40210 None None] MFA Rules not processed for user `0b98694efb1b496c9dfb794671912f64`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:40.489330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3b246353-f4f4-4530-8bd0-786e14e40210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:40.583567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 926/1877] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:40.592148 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fec731-4efb-4170-898b-e112d59b1f38 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:40.592753 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fec731-4efb-4170-898b-e112d59b1f38 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:40.593044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fec731-4efb-4170-898b-e112d59b1f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:40.597617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 952/1878] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:40.611560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b246353-f4f4-4530-8bd0-786e14e40210 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:40.612644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-87fec731-4efb-4170-898b-e112d59b1f38 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:40.613235 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3b246353-f4f4-4530-8bd0-786e14e40210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:40.613806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-87fec731-4efb-4170-898b-e112d59b1f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:40.621982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 927/1879] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:40.627154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fec731-4efb-4170-898b-e112d59b1f38 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:40.637311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fec731-4efb-4170-898b-e112d59b1f38 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:40.645784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71959a66-fc4e-4639-9541-2a801377cc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:40.646081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71959a66-fc4e-4639-9541-2a801377cc8b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:40.646293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71959a66-fc4e-4639-9541-2a801377cc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:40.646852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71959a66-fc4e-4639-9541-2a801377cc8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:40.647889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71959a66-fc4e-4639-9541-2a801377cc8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:40.647889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71959a66-fc4e-4639-9541-2a801377cc8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:40.649589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71959a66-fc4e-4639-9541-2a801377cc8b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:40.676885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 928/1880] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:40.679469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71959a66-fc4e-4639-9541-2a801377cc8b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:40.692267 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b246353-f4f4-4530-8bd0-786e14e40210 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:40.693614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71959a66-fc4e-4639-9541-2a801377cc8b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:40.696217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be009fac-68fd-4ee5-bb66-ac9f1c3cfbf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:40.696835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be009fac-68fd-4ee5-bb66-ac9f1c3cfbf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:40.697120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be009fac-68fd-4ee5-bb66-ac9f1c3cfbf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:40.697396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be009fac-68fd-4ee5-bb66-ac9f1c3cfbf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:40.699289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-be009fac-68fd-4ee5-bb66-ac9f1c3cfbf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:40.701022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5649f7-11de-495e-af11-ed322fc27093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:40.702728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5649f7-11de-495e-af11-ed322fc27093 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:40.703004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5649f7-11de-495e-af11-ed322fc27093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:40.703489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5649f7-11de-495e-af11-ed322fc27093 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:40.704231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5649f7-11de-495e-af11-ed322fc27093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:40.707105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5649f7-11de-495e-af11-ed322fc27093 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:40.811118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be009fac-68fd-4ee5-bb66-ac9f1c3cfbf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:40.811118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be009fac-68fd-4ee5-bb66-ac9f1c3cfbf7 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:40.823894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 953/1881] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:40.853758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 929/1882] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:40 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:40.858560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be009fac-68fd-4ee5-bb66-ac9f1c3cfbf7 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:40.878677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be009fac-68fd-4ee5-bb66-ac9f1c3cfbf7 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:41.016968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8c405-c7db-4ee8-a4d8-5c7c25258fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:41.016968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8c405-c7db-4ee8-a4d8-5c7c25258fca admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.016968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8c405-c7db-4ee8-a4d8-5c7c25258fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.016968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c8c405-c7db-4ee8-a4d8-5c7c25258fca admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.018007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8c405-c7db-4ee8-a4d8-5c7c25258fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:41.020797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c8c405-c7db-4ee8-a4d8-5c7c25258fca admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:41.130273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5649f7-11de-495e-af11-ed322fc27093 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:41.132527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4b5649f7-11de-495e-af11-ed322fc27093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:41.148774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5649f7-11de-495e-af11-ed322fc27093 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:41.154661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:41.156040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 954/1883] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:40 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:41.156186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.156186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.156461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] PATH_INFO: `/v3/projects/2383b5ae9b554c4880c4ba0495aa0226` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.157803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2383b5ae9b554c4880c4ba0495aa0226)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:41.160045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:41.160167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8c405-c7db-4ee8-a4d8-5c7c25258fca admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:41.177172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c8c405-c7db-4ee8-a4d8-5c7c25258fca admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:41.177436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8de1-578d-47a0-ba71-2fc2fcceafec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:41.178239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8de1-578d-47a0-ba71-2fc2fcceafec admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.178663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8de1-578d-47a0-ba71-2fc2fcceafec admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.178937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a8de1-578d-47a0-ba71-2fc2fcceafec admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.179737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a8de1-578d-47a0-ba71-2fc2fcceafec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:41.181449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a8de1-578d-47a0-ba71-2fc2fcceafec admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:41.195387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 955/1884] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:10:41.199599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8de1-578d-47a0-ba71-2fc2fcceafec admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:41.210802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a8de1-578d-47a0-ba71-2fc2fcceafec admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:41.216870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f3409-7949-422b-a204-8981b1857881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:41.217715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f3409-7949-422b-a204-8981b1857881 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.218012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f3409-7949-422b-a204-8981b1857881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.218281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f3409-7949-422b-a204-8981b1857881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.219025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f3409-7949-422b-a204-8981b1857881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:41.220737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485f3409-7949-422b-a204-8981b1857881 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:41.233097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 956/1885] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:41.237605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f3409-7949-422b-a204-8981b1857881 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:41.256930 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f3409-7949-422b-a204-8981b1857881 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:41.262916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b631e-0056-4c64-b354-4833cf0b8c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:41.264662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b631e-0056-4c64-b354-4833cf0b8c79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.264948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b631e-0056-4c64-b354-4833cf0b8c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.265262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b631e-0056-4c64-b354-4833cf0b8c79 admin admin] PATH_INFO: `/v3/projects/24bc7ed2f01447678c32659ed429a846/users/ec1e0868ec9f46a08e14de0c17743682/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.275250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2383b5ae9b554c4880c4ba0495aa0226', 'request_id': 'req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:41.281922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2383b5ae9b554c4880c4ba0495aa0226', 'request_id': 'req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:41.282097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b631e-0056-4c64-b354-4833cf0b8c79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24bc7ed2f01447678c32659ed429a846, user_id=ec1e0868ec9f46a08e14de0c17743682, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:41.284742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b631e-0056-4c64-b354-4833cf0b8c79 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:41.373181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2383b5ae9b554c4880c4ba0495aa0226', 'request_id': 'req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:41.382431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 957/1886] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:41 2022] PUT /identity/v3/projects/24bc7ed2f01447678c32659ed429a846/users/ec1e0868ec9f46a08e14de0c17743682/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:41.392412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102139c-3bd5-49ef-8b89-18d95a19c4ae None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.392707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102139c-3bd5-49ef-8b89-18d95a19c4ae None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.392989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102139c-3bd5-49ef-8b89-18d95a19c4ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.409359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] The token cache is being invalidate because project 2383b5ae9b554c4880c4ba0495aa0226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:41.409664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:41.410469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5c7a70f6-4a8f-4285-ab63-d35e384e95fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:41.412810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 930/1887] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:41 2022] DELETE /identity/v3/projects/2383b5ae9b554c4880c4ba0495aa0226 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:41.422126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1f91-1b5a-4b1f-b02b-e9b5e231f983 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.422126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1f91-1b5a-4b1f-b02b-e9b5e231f983 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.422126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5f1f91-1b5a-4b1f-b02b-e9b5e231f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.437964 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2102139c-3bd5-49ef-8b89-18d95a19c4ae None None] MFA Rules not processed for user `ec1e0868ec9f46a08e14de0c17743682`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:41.444034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2102139c-3bd5-49ef-8b89-18d95a19c4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:41.451021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-be5f1f91-1b5a-4b1f-b02b-e9b5e231f983 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:41.452075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-be5f1f91-1b5a-4b1f-b02b-e9b5e231f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:41.538752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 931/1888] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:41.547970 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 958/1889] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:41.549956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612dfd-ae38-4ec7-b29a-eafcffe08868 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.550254 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612dfd-ae38-4ec7-b29a-eafcffe08868 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.550537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca612dfd-ae38-4ec7-b29a-eafcffe08868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.558661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102139c-3bd5-49ef-8b89-18d95a19c4ae None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:41.560646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2102139c-3bd5-49ef-8b89-18d95a19c4ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:41.593803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ca612dfd-ae38-4ec7-b29a-eafcffe08868 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:41.595328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ca612dfd-ae38-4ec7-b29a-eafcffe08868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:41.614653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 932/1890] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:41.619064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca612dfd-ae38-4ec7-b29a-eafcffe08868 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:41.657832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca612dfd-ae38-4ec7-b29a-eafcffe08868 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:41.669363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531a6e1-e1d5-43dc-a38a-43bf5bb9ca9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:41.671253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531a6e1-e1d5-43dc-a38a-43bf5bb9ca9e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.672847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531a6e1-e1d5-43dc-a38a-43bf5bb9ca9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.672847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531a6e1-e1d5-43dc-a38a-43bf5bb9ca9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.673346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531a6e1-e1d5-43dc-a38a-43bf5bb9ca9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:41.673583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531a6e1-e1d5-43dc-a38a-43bf5bb9ca9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:41.675198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d531a6e1-e1d5-43dc-a38a-43bf5bb9ca9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:41.684494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102139c-3bd5-49ef-8b89-18d95a19c4ae None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:41.689558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f231a1d-19e0-41b4-ae18-638f9ecb00c5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2169b05e64224f69bcc1d9ce912a60e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:41.690219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f231a1d-19e0-41b4-ae18-638f9ecb00c5 service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.690890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 933/1891] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:41.692188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f231a1d-19e0-41b4-ae18-638f9ecb00c5 service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.692516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f231a1d-19e0-41b4-ae18-638f9ecb00c5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.706768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f231a1d-19e0-41b4-ae18-638f9ecb00c5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:41.708455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f231a1d-19e0-41b4-ae18-638f9ecb00c5 service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:41.712117 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531a6e1-e1d5-43dc-a38a-43bf5bb9ca9e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:41.721074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 959/1892] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:10:41.731500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531a6e1-e1d5-43dc-a38a-43bf5bb9ca9e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:41.737449 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857f12-e8e9-4739-a18d-5d6d6328145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:41.738267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857f12-e8e9-4739-a18d-5d6d6328145f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.738698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857f12-e8e9-4739-a18d-5d6d6328145f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.738979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50857f12-e8e9-4739-a18d-5d6d6328145f admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.739672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50857f12-e8e9-4739-a18d-5d6d6328145f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:41.741611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50857f12-e8e9-4739-a18d-5d6d6328145f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:41.883417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 934/1893] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:41 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:41.887227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f231a1d-19e0-41b4-ae18-638f9ecb00c5 service glance] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:41.903362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f231a1d-19e0-41b4-ae18-638f9ecb00c5 service glance] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:41.989630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbd659-0189-4fa6-b808-74edf785bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:41.990790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbd659-0189-4fa6-b808-74edf785bb8b admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:41.991386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbd659-0189-4fa6-b808-74edf785bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:41.991763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbd659-0189-4fa6-b808-74edf785bb8b admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:41.992757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbd659-0189-4fa6-b808-74edf785bb8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:41.995079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbd659-0189-4fa6-b808-74edf785bb8b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:42.095965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 960/1894] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:41 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:10:42.098069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857f12-e8e9-4739-a18d-5d6d6328145f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:42.137836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50857f12-e8e9-4739-a18d-5d6d6328145f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:42.157590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ee5c6-0c5a-4dc0-8da8-8add4f3feec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:42.157897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbd659-0189-4fa6-b808-74edf785bb8b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:42.158413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ee5c6-0c5a-4dc0-8da8-8add4f3feec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:42.158693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ee5c6-0c5a-4dc0-8da8-8add4f3feec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:42.158971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119ee5c6-0c5a-4dc0-8da8-8add4f3feec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:42.159722 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ee5c6-0c5a-4dc0-8da8-8add4f3feec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:42.160481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d6bbd659-0189-4fa6-b808-74edf785bb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:42.161650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119ee5c6-0c5a-4dc0-8da8-8add4f3feec7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:42.178002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbd659-0189-4fa6-b808-74edf785bb8b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:42.181829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 935/1895] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:42.190403 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ee5c6-0c5a-4dc0-8da8-8add4f3feec7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:42.197926 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:42.203069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:42.203069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:42.203069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] PATH_INFO: `/v3/users/4cd7d58b7502486c8dbfe96019397394` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:42.203069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cd7d58b7502486c8dbfe96019397394)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:42.204855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:42.210654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119ee5c6-0c5a-4dc0-8da8-8add4f3feec7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:42.222913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bded10-05c8-4400-981f-a0ea5929ff9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:42.226929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bded10-05c8-4400-981f-a0ea5929ff9e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:42.226929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bded10-05c8-4400-981f-a0ea5929ff9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:42.226929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bded10-05c8-4400-981f-a0ea5929ff9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:42.226929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bded10-05c8-4400-981f-a0ea5929ff9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:42.226929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bded10-05c8-4400-981f-a0ea5929ff9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:42.249142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 936/1896] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:42.256454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bded10-05c8-4400-981f-a0ea5929ff9e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:42.262865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bded10-05c8-4400-981f-a0ea5929ff9e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:42.268429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a813545c-9c78-4669-8a05-ae33f4b0283a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:42.269381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813545c-9c78-4669-8a05-ae33f4b0283a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:42.269758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813545c-9c78-4669-8a05-ae33f4b0283a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:42.270037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a813545c-9c78-4669-8a05-ae33f4b0283a admin admin] PATH_INFO: `/v3/projects/4b9508552fb147df84bf0f2e4a15138f/users/3bea848a526e47fb9d27f2c2956b314f/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:42.275828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:42.289005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813545c-9c78-4669-8a05-ae33f4b0283a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9508552fb147df84bf0f2e4a15138f, user_id=3bea848a526e47fb9d27f2c2956b314f, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:42.292453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a813545c-9c78-4669-8a05-ae33f4b0283a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:42.420345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 937/1897] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:42 2022] PUT /identity/v3/projects/4b9508552fb147df84bf0f2e4a15138f/users/3bea848a526e47fb9d27f2c2956b314f/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:42.431835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3eaa6-835a-40cd-a3a2-25c44f11c79c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:42.432181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3eaa6-835a-40cd-a3a2-25c44f11c79c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:42.432441 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d3eaa6-835a-40cd-a3a2-25c44f11c79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:42.483620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b4d3eaa6-835a-40cd-a3a2-25c44f11c79c None None] MFA Rules not processed for user `3bea848a526e47fb9d27f2c2956b314f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:42.485445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b4d3eaa6-835a-40cd-a3a2-25c44f11c79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:42.549169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cd7d58b7502486c8dbfe96019397394'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:42.562561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 938/1898] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:42.574487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3eaa6-835a-40cd-a3a2-25c44f11c79c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:42.576143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b4d3eaa6-835a-40cd-a3a2-25c44f11c79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:42.644732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d3eaa6-835a-40cd-a3a2-25c44f11c79c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:42.648489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6530b-710e-4726-abf8-5d9047df2d47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:42.649873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6530b-710e-4726-abf8-5d9047df2d47 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:42.650162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6530b-710e-4726-abf8-5d9047df2d47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:42.650805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6530b-710e-4726-abf8-5d9047df2d47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:42.663985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6530b-710e-4726-abf8-5d9047df2d47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:42.665911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d6530b-710e-4726-abf8-5d9047df2d47 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:42.676899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 939/1899] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:10:42.692603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cd7d58b7502486c8dbfe96019397394'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:42.697439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6530b-710e-4726-abf8-5d9047df2d47 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:42.714056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cd7d58b7502486c8dbfe96019397394'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:42.715353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cd7d58b7502486c8dbfe96019397394'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:42.743508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-50406f94-ef88-477e-80f7-50aa84609629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cd7d58b7502486c8dbfe96019397394'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:42.758877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 961/1900] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:42 2022] DELETE /identity/v3/users/4cd7d58b7502486c8dbfe96019397394 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:42.764237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503fc31-6dd0-4efb-9e9a-5a0e591be4c8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:42.765557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503fc31-6dd0-4efb-9e9a-5a0e591be4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:42.766028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503fc31-6dd0-4efb-9e9a-5a0e591be4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:42.791122 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6530b-710e-4726-abf8-5d9047df2d47 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:42.793342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1503fc31-6dd0-4efb-9e9a-5a0e591be4c8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:42.796679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1503fc31-6dd0-4efb-9e9a-5a0e591be4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:42.907392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 962/1901] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:42.911870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:42.912791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:42.913057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:42.913326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] PATH_INFO: `/v3/users/3bea848a526e47fb9d27f2c2956b314f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:42.916908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bea848a526e47fb9d27f2c2956b314f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:42.918121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503fc31-6dd0-4efb-9e9a-5a0e591be4c8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:42.919081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:42.923255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1503fc31-6dd0-4efb-9e9a-5a0e591be4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:42.962158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:43.006236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1503fc31-6dd0-4efb-9e9a-5a0e591be4c8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:43.011135 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b5a70-f06e-4e32-937c-3ceab5514a6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:43.012234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5a70-f06e-4e32-937c-3ceab5514a6c service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:43.012624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5a70-f06e-4e32-937c-3ceab5514a6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:43.013006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5b5a70-f06e-4e32-937c-3ceab5514a6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:43.032200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b5a70-f06e-4e32-937c-3ceab5514a6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:43.033692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5b5a70-f06e-4e32-937c-3ceab5514a6c service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:43.066212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 963/1902] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:43.066896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b5a70-f06e-4e32-937c-3ceab5514a6c service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:43.068277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5f5b5a70-f06e-4e32-937c-3ceab5514a6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:43.132809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5b5a70-f06e-4e32-937c-3ceab5514a6c service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:43.136540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c37f2-ca26-4dc4-aac7-8685ae9edc57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:43.137228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c37f2-ca26-4dc4-aac7-8685ae9edc57 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:43.137506 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c37f2-ca26-4dc4-aac7-8685ae9edc57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:43.137780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c37f2-ca26-4dc4-aac7-8685ae9edc57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:43.140155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a27c37f2-ca26-4dc4-aac7-8685ae9edc57 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:43.225887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c37f2-ca26-4dc4-aac7-8685ae9edc57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:43.227406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c37f2-ca26-4dc4-aac7-8685ae9edc57 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:43.240086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 964/1903] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:43.249748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bea848a526e47fb9d27f2c2956b314f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:43.271735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bea848a526e47fb9d27f2c2956b314f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:43.280221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bea848a526e47fb9d27f2c2956b314f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:43.283639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bea848a526e47fb9d27f2c2956b314f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:43.283639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bea848a526e47fb9d27f2c2956b314f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:43.366809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 940/1904] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:42 2022] DELETE /identity/v3/users/3bea848a526e47fb9d27f2c2956b314f => generated 0 bytes in 670 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:43.381644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8679c-f7ab-4e9d-93c7-9e29f3a0b752 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:43.381990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8679c-f7ab-4e9d-93c7-9e29f3a0b752 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:43.382253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8679c-f7ab-4e9d-93c7-9e29f3a0b752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:43.403220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-83b8679c-f7ab-4e9d-93c7-9e29f3a0b752 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:43.405215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-83b8679c-f7ab-4e9d-93c7-9e29f3a0b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:43.487512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:43.521942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 965/1905] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:43.532601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:43.534064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:43.622680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab035d16-811a-4dc5-8c1b-ee1e6f7a40b9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:43.626743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3475-057b-4d58-aa4a-4ac760c701b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:43.627480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3475-057b-4d58-aa4a-4ac760c701b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:43.627874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3475-057b-4d58-aa4a-4ac760c701b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:43.628184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109d3475-057b-4d58-aa4a-4ac760c701b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:43.638100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d3475-057b-4d58-aa4a-4ac760c701b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:43.640182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109d3475-057b-4d58-aa4a-4ac760c701b3 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:43.651424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 941/1906] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:43.833109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8679c-f7ab-4e9d-93c7-9e29f3a0b752 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:43.841458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-83b8679c-f7ab-4e9d-93c7-9e29f3a0b752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:43.864866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8679c-f7ab-4e9d-93c7-9e29f3a0b752 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:43.874509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:43.876060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:43.876587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:43.876956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] PATH_INFO: `/v3/projects/35ba0b280599437fb9683a2c9d3b344f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:43.881126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35ba0b280599437fb9683a2c9d3b344f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:43.889759 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:44.167445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35ba0b280599437fb9683a2c9d3b344f', 'request_id': 'req-4795169c-20a3-4456-99f4-0641650b6405'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.175297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35ba0b280599437fb9683a2c9d3b344f', 'request_id': 'req-4795169c-20a3-4456-99f4-0641650b6405'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.186010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:44.276373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35ba0b280599437fb9683a2c9d3b344f', 'request_id': 'req-4795169c-20a3-4456-99f4-0641650b6405'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.290808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] The token cache is being invalidate because project 35ba0b280599437fb9683a2c9d3b344f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:44.291403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.292222 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.293915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 966/1907] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:43 2022] DELETE /identity/v3/projects/35ba0b280599437fb9683a2c9d3b344f => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:44.299161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3475-057b-4d58-aa4a-4ac760c701b3 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:44.317306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109d3475-057b-4d58-aa4a-4ac760c701b3 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:44.381866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:44.382763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:44.383048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:44.383323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] PATH_INFO: `/v3/users/47e500a3c6c9425e8414a4a3fc5d7832` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:44.384607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e500a3c6c9425e8414a4a3fc5d7832)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:44.386573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:44.459734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:44.461743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:44.476206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795169c-20a3-4456-99f4-0641650b6405 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:44.481161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:44.481934 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:44.482795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:44.483233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] PATH_INFO: `/v3/projects/4b9508552fb147df84bf0f2e4a15138f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:44.485075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9508552fb147df84bf0f2e4a15138f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:44.487110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:44.692095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9508552fb147df84bf0f2e4a15138f', 'request_id': 'req-77bafaf6-3d98-4a62-8e68-ea76d8e81315'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.694433 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e500a3c6c9425e8414a4a3fc5d7832'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.703387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9508552fb147df84bf0f2e4a15138f', 'request_id': 'req-77bafaf6-3d98-4a62-8e68-ea76d8e81315'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.716491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e500a3c6c9425e8414a4a3fc5d7832'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.743541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e500a3c6c9425e8414a4a3fc5d7832'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.755588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e500a3c6c9425e8414a4a3fc5d7832'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.755588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f237be41-f61d-4ecf-affc-ddb52ca409fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e500a3c6c9425e8414a4a3fc5d7832'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.807457 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9508552fb147df84bf0f2e4a15138f', 'request_id': 'req-77bafaf6-3d98-4a62-8e68-ea76d8e81315'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.820252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] The token cache is being invalidate because project 4b9508552fb147df84bf0f2e4a15138f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:44.820543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.821205 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-77bafaf6-3d98-4a62-8e68-ea76d8e81315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:44.822946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 967/1908] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:44 2022] DELETE /identity/v3/projects/4b9508552fb147df84bf0f2e4a15138f => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:44.828550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72971d25-319a-46b8-a590-0a64888eea89 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:44.828882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72971d25-319a-46b8-a590-0a64888eea89 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:44.829161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72971d25-319a-46b8-a590-0a64888eea89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:44.848711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-72971d25-319a-46b8-a590-0a64888eea89 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:44.849911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-72971d25-319a-46b8-a590-0a64888eea89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:44.910657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:44.915857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 942/1909] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:44 2022] DELETE /identity/v3/users/47e500a3c6c9425e8414a4a3fc5d7832 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:44.918245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 968/1910] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:44.932980 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af4faf-3901-4adb-897b-faad16ae42de None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:44.939694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af4faf-3901-4adb-897b-faad16ae42de None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:44.939694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2af4faf-3901-4adb-897b-faad16ae42de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:44.970453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a2af4faf-3901-4adb-897b-faad16ae42de None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:44.974051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a2af4faf-3901-4adb-897b-faad16ae42de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:45.045831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 943/1911] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:45.051794 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72971d25-319a-46b8-a590-0a64888eea89 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:45.066371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72971d25-319a-46b8-a590-0a64888eea89 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:45.092422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc91576-4151-40c3-8fa6-2224ab89d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:45.093155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91576-4151-40c3-8fa6-2224ab89d38d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:45.093439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91576-4151-40c3-8fa6-2224ab89d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:45.093712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc91576-4151-40c3-8fa6-2224ab89d38d admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:45.094445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc91576-4151-40c3-8fa6-2224ab89d38d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:45.094747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc91576-4151-40c3-8fa6-2224ab89d38d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:45.096423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc91576-4151-40c3-8fa6-2224ab89d38d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:45.113301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 969/1912] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:45.117329 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af4faf-3901-4adb-897b-faad16ae42de None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:45.128373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2af4faf-3901-4adb-897b-faad16ae42de None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:45.139727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ce9d4-91c4-4a1f-9ea0-551f80131e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:45.139727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ce9d4-91c4-4a1f-9ea0-551f80131e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:45.139727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ce9d4-91c4-4a1f-9ea0-551f80131e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:45.139727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ce9d4-91c4-4a1f-9ea0-551f80131e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:45.140753 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ce9d4-91c4-4a1f-9ea0-551f80131e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:45.140753 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ce9d4-91c4-4a1f-9ea0-551f80131e70 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:45.286616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 944/1913] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:45 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:45.288007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc91576-4151-40c3-8fa6-2224ab89d38d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:45.311485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc91576-4151-40c3-8fa6-2224ab89d38d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:45.396715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f702d-56ab-4684-8dfd-aeda6c68619e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:45.399515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f702d-56ab-4684-8dfd-aeda6c68619e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:45.399515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f702d-56ab-4684-8dfd-aeda6c68619e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:45.399515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58f702d-56ab-4684-8dfd-aeda6c68619e admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:45.399515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f702d-56ab-4684-8dfd-aeda6c68619e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:45.403831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58f702d-56ab-4684-8dfd-aeda6c68619e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:45.494830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 970/1914] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:45 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:45.496145 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ce9d4-91c4-4a1f-9ea0-551f80131e70 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:45.507273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ce9d4-91c4-4a1f-9ea0-551f80131e70 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:45.511849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b21507-80f7-4ace-83fa-a8199d793cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:45.512546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b21507-80f7-4ace-83fa-a8199d793cdb admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:45.512924 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b21507-80f7-4ace-83fa-a8199d793cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:45.513302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b21507-80f7-4ace-83fa-a8199d793cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:45.514218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b21507-80f7-4ace-83fa-a8199d793cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:45.515833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b21507-80f7-4ace-83fa-a8199d793cdb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:45.531867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 945/1915] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:10:45.532738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f702d-56ab-4684-8dfd-aeda6c68619e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:45.543687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58f702d-56ab-4684-8dfd-aeda6c68619e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:45.549644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb9914-c220-4710-8a3e-0a241239f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:45.550310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb9914-c220-4710-8a3e-0a241239f05d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:45.550587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb9914-c220-4710-8a3e-0a241239f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:45.550868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb9914-c220-4710-8a3e-0a241239f05d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:45.551748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb9914-c220-4710-8a3e-0a241239f05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:45.553327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb9914-c220-4710-8a3e-0a241239f05d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:45.565018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 971/1916] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:45.569398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b21507-80f7-4ace-83fa-a8199d793cdb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:45.580250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b21507-80f7-4ace-83fa-a8199d793cdb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:45.586314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c920a5-c148-4ddf-a086-b4d9391abe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:45.587246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c920a5-c148-4ddf-a086-b4d9391abe11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:45.587590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c920a5-c148-4ddf-a086-b4d9391abe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:45.587803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c920a5-c148-4ddf-a086-b4d9391abe11 admin admin] PATH_INFO: `/v3/projects/4ac8476adb054207954d5f4d9669d987/users/c93c0bd050c34c388499d31a96a6b4de/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:45.603741 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c920a5-c148-4ddf-a086-b4d9391abe11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ac8476adb054207954d5f4d9669d987, user_id=c93c0bd050c34c388499d31a96a6b4de, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:45.606560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c920a5-c148-4ddf-a086-b4d9391abe11 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:45.699410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 946/1917] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:45 2022] PUT /identity/v3/projects/4ac8476adb054207954d5f4d9669d987/users/c93c0bd050c34c388499d31a96a6b4de/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:45.714131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e44de-bbc3-4fa3-9af6-522d98f380ff None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:45.714419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e44de-bbc3-4fa3-9af6-522d98f380ff None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:45.714692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e44de-bbc3-4fa3-9af6-522d98f380ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:45.741608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c920a5-c148-4ddf-a086-b4d9391abe11 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:45.743716 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-69c920a5-c148-4ddf-a086-b4d9391abe11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:45.743868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2a8e44de-bbc3-4fa3-9af6-522d98f380ff None None] MFA Rules not processed for user `c93c0bd050c34c388499d31a96a6b4de`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:45.745517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2a8e44de-bbc3-4fa3-9af6-522d98f380ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:45.830643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c920a5-c148-4ddf-a086-b4d9391abe11 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:45.835069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:45.836212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:45.836492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:45.836769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] PATH_INFO: `/v3/projects/b185593b75c3407388450c0c20c73b5d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:45.838190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b185593b75c3407388450c0c20c73b5d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:45.840703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:45.876122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 972/1918] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:45.878472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e44de-bbc3-4fa3-9af6-522d98f380ff None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:45.880941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2a8e44de-bbc3-4fa3-9af6-522d98f380ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:45.975263 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e44de-bbc3-4fa3-9af6-522d98f380ff None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:45.979199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d590a95b-4f4e-4d27-b1f4-d16d49ce0289 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:45.979855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590a95b-4f4e-4d27-b1f4-d16d49ce0289 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:45.980167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590a95b-4f4e-4d27-b1f4-d16d49ce0289 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:45.980442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d590a95b-4f4e-4d27-b1f4-d16d49ce0289 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:45.994531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590a95b-4f4e-4d27-b1f4-d16d49ce0289 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:45.996292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d590a95b-4f4e-4d27-b1f4-d16d49ce0289 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:46.007292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 973/1919] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:45 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:46.015483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b185593b75c3407388450c0c20c73b5d', 'request_id': 'req-af048439-3f00-4e02-9af3-76b201ecb521'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:46.021099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b185593b75c3407388450c0c20c73b5d', 'request_id': 'req-af048439-3f00-4e02-9af3-76b201ecb521'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:46.140826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b185593b75c3407388450c0c20c73b5d', 'request_id': 'req-af048439-3f00-4e02-9af3-76b201ecb521'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:46.171610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:46.174685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] The token cache is being invalidate because project b185593b75c3407388450c0c20c73b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:46.176270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:46.176270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-af048439-3f00-4e02-9af3-76b201ecb521 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:46.179028 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 947/1920] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:45 2022] DELETE /identity/v3/projects/b185593b75c3407388450c0c20c73b5d => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:46.186766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2deae-3608-4157-9350-8895734ae4fe None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:46.187052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2deae-3608-4157-9350-8895734ae4fe None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:46.187570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2deae-3608-4157-9350-8895734ae4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:46.222788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-98a2deae-3608-4157-9350-8895734ae4fe None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:46.224061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-98a2deae-3608-4157-9350-8895734ae4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:46.299000 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 974/1921] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:46.308057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c19c46-0dd5-4045-bd2b-650900939ac0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:46.308229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c19c46-0dd5-4045-bd2b-650900939ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:46.308508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c19c46-0dd5-4045-bd2b-650900939ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:46.329494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-66c19c46-0dd5-4045-bd2b-650900939ac0 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:46.333101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-66c19c46-0dd5-4045-bd2b-650900939ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:46.353362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 948/1922] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:46.364031 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2deae-3608-4157-9350-8895734ae4fe None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:46.384666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2deae-3608-4157-9350-8895734ae4fe None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:46.395891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c608c2c-83fe-4736-b384-4472b4971536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:46.396596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c608c2c-83fe-4736-b384-4472b4971536 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:46.396938 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c608c2c-83fe-4736-b384-4472b4971536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:46.397154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c608c2c-83fe-4736-b384-4472b4971536 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:46.399068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c608c2c-83fe-4736-b384-4472b4971536 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:46.399390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c608c2c-83fe-4736-b384-4472b4971536 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:46.406182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c608c2c-83fe-4736-b384-4472b4971536 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:46.419995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 975/1923] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:46.424202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c19c46-0dd5-4045-bd2b-650900939ac0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:46.434477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c19c46-0dd5-4045-bd2b-650900939ac0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:46.442362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720100-42b2-44b8-8391-70f63bfe799a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:46.443312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720100-42b2-44b8-8391-70f63bfe799a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:46.443767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720100-42b2-44b8-8391-70f63bfe799a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:46.444294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc720100-42b2-44b8-8391-70f63bfe799a admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:46.445182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc720100-42b2-44b8-8391-70f63bfe799a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:46.447614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc720100-42b2-44b8-8391-70f63bfe799a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:46.546523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 949/1924] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:46 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:46.551171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c608c2c-83fe-4736-b384-4472b4971536 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:46.565341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c608c2c-83fe-4736-b384-4472b4971536 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:46.644297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f4359-f68e-44a8-ba4e-4a5b11f3e998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:46.644970 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4359-f68e-44a8-ba4e-4a5b11f3e998 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:46.645249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4359-f68e-44a8-ba4e-4a5b11f3e998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:46.645613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9f4359-f68e-44a8-ba4e-4a5b11f3e998 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:46.646447 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f4359-f68e-44a8-ba4e-4a5b11f3e998 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:46.648538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9f4359-f68e-44a8-ba4e-4a5b11f3e998 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:46.766286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 976/1925] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:46 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:46.767509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720100-42b2-44b8-8391-70f63bfe799a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:46.800038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc720100-42b2-44b8-8391-70f63bfe799a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:46.814434 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a139e88-a1e1-4524-8ace-66b7e611de1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:46.815608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a139e88-a1e1-4524-8ace-66b7e611de1b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:46.816197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a139e88-a1e1-4524-8ace-66b7e611de1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:46.816750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a139e88-a1e1-4524-8ace-66b7e611de1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:46.817579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a139e88-a1e1-4524-8ace-66b7e611de1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:46.820735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a139e88-a1e1-4524-8ace-66b7e611de1b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:46.836673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 950/1926] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:46.838132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f4359-f68e-44a8-ba4e-4a5b11f3e998 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:46.851218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9f4359-f68e-44a8-ba4e-4a5b11f3e998 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:46.856600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14695bf9-8160-44f8-8725-9238a9bb6d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:46.857976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695bf9-8160-44f8-8725-9238a9bb6d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:46.858103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695bf9-8160-44f8-8725-9238a9bb6d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:46.858379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695bf9-8160-44f8-8725-9238a9bb6d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:46.859301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14695bf9-8160-44f8-8725-9238a9bb6d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:46.861024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14695bf9-8160-44f8-8725-9238a9bb6d04 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:46.874347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 977/1927] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:46.878794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a139e88-a1e1-4524-8ace-66b7e611de1b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:46.889735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a139e88-a1e1-4524-8ace-66b7e611de1b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:46.895712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707c444-bb38-4f95-9fa6-b2c6fb149fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:46.896874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707c444-bb38-4f95-9fa6-b2c6fb149fa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:46.897227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707c444-bb38-4f95-9fa6-b2c6fb149fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:46.897572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707c444-bb38-4f95-9fa6-b2c6fb149fa9 admin admin] PATH_INFO: `/v3/projects/c3e0dc07889b418087ace98dec9cd3b2/users/c11e369c8ba542f6b089a472e9f42099/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:46.921012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707c444-bb38-4f95-9fa6-b2c6fb149fa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3e0dc07889b418087ace98dec9cd3b2, user_id=c11e369c8ba542f6b089a472e9f42099, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:46.924079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707c444-bb38-4f95-9fa6-b2c6fb149fa9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:47.108703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 951/1928] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:46 2022] PUT /identity/v3/projects/c3e0dc07889b418087ace98dec9cd3b2/users/c11e369c8ba542f6b089a472e9f42099/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:47.109085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e454-07df-480a-ad9c-286cdc9f062e None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:47.109085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e454-07df-480a-ad9c-286cdc9f062e None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:47.109085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4e454-07df-480a-ad9c-286cdc9f062e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:47.166635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-92b4e454-07df-480a-ad9c-286cdc9f062e None None] MFA Rules not processed for user `c11e369c8ba542f6b089a472e9f42099`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:47.168127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-92b4e454-07df-480a-ad9c-286cdc9f062e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:47.224581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:47.267511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 978/1929] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:47.302391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707c444-bb38-4f95-9fa6-b2c6fb149fa9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:47.442087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707c444-bb38-4f95-9fa6-b2c6fb149fa9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:47.450667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38cf70-142b-4ddb-ad1d-4d9458fcf7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:47.452065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38cf70-142b-4ddb-ad1d-4d9458fcf7ec admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:47.452494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38cf70-142b-4ddb-ad1d-4d9458fcf7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:47.452950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb38cf70-142b-4ddb-ad1d-4d9458fcf7ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:47.453850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38cf70-142b-4ddb-ad1d-4d9458fcf7ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:47.457025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb38cf70-142b-4ddb-ad1d-4d9458fcf7ec admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:47.628861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 952/1930] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:47 2022] POST /identity/v3/projects => generated 377 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:47.629981 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e454-07df-480a-ad9c-286cdc9f062e None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:47.641575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4e454-07df-480a-ad9c-286cdc9f062e None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:47.709784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6ebb-5947-4cb4-b375-0a104450345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:47.710383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6ebb-5947-4cb4-b375-0a104450345d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:47.710668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6ebb-5947-4cb4-b375-0a104450345d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:47.710940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6ebb-5947-4cb4-b375-0a104450345d admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:47.711662 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe6ebb-5947-4cb4-b375-0a104450345d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:47.713684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe6ebb-5947-4cb4-b375-0a104450345d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:47.771833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:47.858294 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 979/1931] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:47 2022] POST /identity/v3/users => generated 295 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:10:47.861163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38cf70-142b-4ddb-ad1d-4d9458fcf7ec admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:47.881662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb38cf70-142b-4ddb-ad1d-4d9458fcf7ec admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:47.898643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109518-75b2-437c-88f5-3dd7a9eed9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:47.899459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109518-75b2-437c-88f5-3dd7a9eed9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:47.900014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109518-75b2-437c-88f5-3dd7a9eed9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:47.900363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d109518-75b2-437c-88f5-3dd7a9eed9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:47.901704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d109518-75b2-437c-88f5-3dd7a9eed9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:47.906433 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d109518-75b2-437c-88f5-3dd7a9eed9d2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:47.926184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 953/1932] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:47.930415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6ebb-5947-4cb4-b375-0a104450345d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:47.930995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109518-75b2-437c-88f5-3dd7a9eed9d2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:47.933417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4d109518-75b2-437c-88f5-3dd7a9eed9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:47.942212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6ebb-5947-4cb4-b375-0a104450345d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:47.950628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2271a6-d47b-4226-9a4a-6aae46aa3405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:47.952154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2271a6-d47b-4226-9a4a-6aae46aa3405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:47.952609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2271a6-d47b-4226-9a4a-6aae46aa3405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:47.953085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2271a6-d47b-4226-9a4a-6aae46aa3405 admin admin] PATH_INFO: `/v3/projects/18e458bc2abc42c8b6af6bb29e557860/users/34a7b66d3e57402294a19b8b1ba8cef2/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:47.954641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d109518-75b2-437c-88f5-3dd7a9eed9d2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:47.968444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:47.969487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:47.969875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:47.970706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] PATH_INFO: `/v3/users/b859da7e34ef49419b26e8899a773be1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:47.972542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b859da7e34ef49419b26e8899a773be1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:47.972793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2271a6-d47b-4226-9a4a-6aae46aa3405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e458bc2abc42c8b6af6bb29e557860, user_id=34a7b66d3e57402294a19b8b1ba8cef2, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:47.975048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:47.975839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2271a6-d47b-4226-9a4a-6aae46aa3405 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:48.170755 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 980/1933] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:47 2022] PUT /identity/v3/projects/18e458bc2abc42c8b6af6bb29e557860/users/34a7b66d3e57402294a19b8b1ba8cef2/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:48.174692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2271a6-d47b-4226-9a4a-6aae46aa3405 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:48.268848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2271a6-d47b-4226-9a4a-6aae46aa3405 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:48.272644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b859da7e34ef49419b26e8899a773be1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:48.275864 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d95b6-2202-4d3d-9c23-14b855da44cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:48.276668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d95b6-2202-4d3d-9c23-14b855da44cf admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:48.276949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d95b6-2202-4d3d-9c23-14b855da44cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:48.277858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d95b6-2202-4d3d-9c23-14b855da44cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:48.278791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d95b6-2202-4d3d-9c23-14b855da44cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:48.281390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461d95b6-2202-4d3d-9c23-14b855da44cf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:48.297429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 981/1934] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:48 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:48.297914 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b859da7e34ef49419b26e8899a773be1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:48.302335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d95b6-2202-4d3d-9c23-14b855da44cf admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:48.309320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b859da7e34ef49419b26e8899a773be1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:48.311316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b859da7e34ef49419b26e8899a773be1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:48.312235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bf13ba5-0317-4e2a-8727-6a8c6d747dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b859da7e34ef49419b26e8899a773be1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:48.314538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d95b6-2202-4d3d-9c23-14b855da44cf admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:48.322382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ebf12d-61ea-44e8-9430-a7566b0ddb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:48.325284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebf12d-61ea-44e8-9430-a7566b0ddb3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:48.326121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebf12d-61ea-44e8-9430-a7566b0ddb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:48.326425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ebf12d-61ea-44e8-9430-a7566b0ddb3f admin admin] PATH_INFO: `/v3/projects/18e458bc2abc42c8b6af6bb29e557860/users/34a7b66d3e57402294a19b8b1ba8cef2/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:48.329165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebf12d-61ea-44e8-9430-a7566b0ddb3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=18e458bc2abc42c8b6af6bb29e557860, user_id=34a7b66d3e57402294a19b8b1ba8cef2, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:48.331863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ebf12d-61ea-44e8-9430-a7566b0ddb3f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:48.352523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 982/1935] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:48 2022] PUT /identity/v3/projects/18e458bc2abc42c8b6af6bb29e557860/users/34a7b66d3e57402294a19b8b1ba8cef2/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:48.361983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be953c0a-2b6f-47f3-b2df-da2dec66f44c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:48.362375 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be953c0a-2b6f-47f3-b2df-da2dec66f44c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:48.362844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be953c0a-2b6f-47f3-b2df-da2dec66f44c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:48.398133 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-be953c0a-2b6f-47f3-b2df-da2dec66f44c None None] MFA Rules not processed for user `34a7b66d3e57402294a19b8b1ba8cef2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:48.400071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-be953c0a-2b6f-47f3-b2df-da2dec66f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:48.406828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 954/1936] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:47 2022] DELETE /identity/v3/users/b859da7e34ef49419b26e8899a773be1 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:48.413103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25092f-0f7c-4134-bf52-5264fe5be9bc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:48.413499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25092f-0f7c-4134-bf52-5264fe5be9bc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:48.413876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25092f-0f7c-4134-bf52-5264fe5be9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:48.434701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4e25092f-0f7c-4134-bf52-5264fe5be9bc None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:48.438097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e25092f-0f7c-4134-bf52-5264fe5be9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:48.481009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 983/1937] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:48.494926 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be953c0a-2b6f-47f3-b2df-da2dec66f44c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:48.496480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-be953c0a-2b6f-47f3-b2df-da2dec66f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:48.519779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 955/1938] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:48.530703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25092f-0f7c-4134-bf52-5264fe5be9bc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:48.532516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e25092f-0f7c-4134-bf52-5264fe5be9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:48.569107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be953c0a-2b6f-47f3-b2df-da2dec66f44c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:48.613748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25092f-0f7c-4134-bf52-5264fe5be9bc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:48.617707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb767-9ae4-472f-ab49-e4ec8096b719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:48.618499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb767-9ae4-472f-ab49-e4ec8096b719 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:48.618633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868ba3d-bb5e-4837-9cc2-938c173c6fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:48.618911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb767-9ae4-472f-ab49-e4ec8096b719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:48.619283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40cb767-9ae4-472f-ab49-e4ec8096b719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:48.619386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868ba3d-bb5e-4837-9cc2-938c173c6fcb service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:48.619581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868ba3d-bb5e-4837-9cc2-938c173c6fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:48.619877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868ba3d-bb5e-4837-9cc2-938c173c6fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:48.621672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c868ba3d-bb5e-4837-9cc2-938c173c6fcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:48.631190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb767-9ae4-472f-ab49-e4ec8096b719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:48.632843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40cb767-9ae4-472f-ab49-e4ec8096b719 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:48.644715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 956/1939] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:10:48.692864 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868ba3d-bb5e-4837-9cc2-938c173c6fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:48.694613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868ba3d-bb5e-4837-9cc2-938c173c6fcb service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:48.707204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 984/1940] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:10:49.075471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:49.175584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb767-9ae4-472f-ab49-e4ec8096b719 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:49.177882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c40cb767-9ae4-472f-ab49-e4ec8096b719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:49.207111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40cb767-9ae4-472f-ab49-e4ec8096b719 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:49.224023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:49.227666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:49.228807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:49.229517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] PATH_INFO: `/v3/projects/e1f8ba2e0d5948499376ab56b44343d7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:49.235234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1f8ba2e0d5948499376ab56b44343d7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:49.243854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:49.443520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:49.477759 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1f8ba2e0d5948499376ab56b44343d7', 'request_id': 'req-0b790362-500d-43af-b65e-1676e2a2e978'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:49.487239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1f8ba2e0d5948499376ab56b44343d7', 'request_id': 'req-0b790362-500d-43af-b65e-1676e2a2e978'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:49.573026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1f8ba2e0d5948499376ab56b44343d7', 'request_id': 'req-0b790362-500d-43af-b65e-1676e2a2e978'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:49.590314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] The token cache is being invalidate because project e1f8ba2e0d5948499376ab56b44343d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:49.590314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:49.591063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:49.599664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 957/1941] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:49 2022] DELETE /identity/v3/projects/e1f8ba2e0d5948499376ab56b44343d7 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:49.601562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868ba3d-bb5e-4837-9cc2-938c173c6fcb service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:49.617604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868ba3d-bb5e-4837-9cc2-938c173c6fcb service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:49.739212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:49.740188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:49.741080 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:49.741371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] PATH_INFO: `/v3/users/0b98694efb1b496c9dfb794671912f64` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:49.742679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b98694efb1b496c9dfb794671912f64)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:49.749918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:50.057269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b98694efb1b496c9dfb794671912f64'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:50.220672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b98694efb1b496c9dfb794671912f64'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:50.232255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b98694efb1b496c9dfb794671912f64'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:50.233108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b98694efb1b496c9dfb794671912f64'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:50.250202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fbf6fbb1-2d10-4f4b-9895-4dc5cb646ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b98694efb1b496c9dfb794671912f64'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:50.260859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 985/1942] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:49 2022] DELETE /identity/v3/users/0b98694efb1b496c9dfb794671912f64 => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:50.336301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:51.248140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:51.249964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:51.269236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b790362-500d-43af-b65e-1676e2a2e978 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:51.399850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:51.400942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:51.401535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:51.401979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] PATH_INFO: `/v3/projects/015b0899f3d444518c85c2f8736bcc70` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:51.404031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=015b0899f3d444518c85c2f8736bcc70)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:51.406305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:51.536380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015b0899f3d444518c85c2f8736bcc70', 'request_id': 'req-96646634-6af3-4da6-b14f-de3802603fbf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:51.542833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015b0899f3d444518c85c2f8736bcc70', 'request_id': 'req-96646634-6af3-4da6-b14f-de3802603fbf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:51.646843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015b0899f3d444518c85c2f8736bcc70', 'request_id': 'req-96646634-6af3-4da6-b14f-de3802603fbf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:51.662651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] The token cache is being invalidate because project 015b0899f3d444518c85c2f8736bcc70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:51.666784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:51.666784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-96646634-6af3-4da6-b14f-de3802603fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:51.666784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 958/1943] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:51 2022] DELETE /identity/v3/projects/015b0899f3d444518c85c2f8736bcc70 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:51.671059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04587-857e-4286-b2b3-864d4dd92bf3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:51.671595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04587-857e-4286-b2b3-864d4dd92bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:51.671732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04587-857e-4286-b2b3-864d4dd92bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:51.691879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5ac04587-857e-4286-b2b3-864d4dd92bf3 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:51.693120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5ac04587-857e-4286-b2b3-864d4dd92bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:51.709628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:51.755142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 986/1944] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:51.765745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aaffb-b87a-4c72-95c2-b38673014f8d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:51.766031 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aaffb-b87a-4c72-95c2-b38673014f8d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:51.766360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9aaffb-b87a-4c72-95c2-b38673014f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:51.786708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bf9aaffb-b87a-4c72-95c2-b38673014f8d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:51.788082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bf9aaffb-b87a-4c72-95c2-b38673014f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:51.796999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 959/1945] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:51.801496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac04587-857e-4286-b2b3-864d4dd92bf3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:51.811962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac04587-857e-4286-b2b3-864d4dd92bf3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:51.816036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7f2b-8853-495d-b6cc-d1fa6a82ffc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:51.816642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7f2b-8853-495d-b6cc-d1fa6a82ffc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:51.816921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7f2b-8853-495d-b6cc-d1fa6a82ffc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:51.817193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e7f2b-8853-495d-b6cc-d1fa6a82ffc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:51.817948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7f2b-8853-495d-b6cc-d1fa6a82ffc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:51.818250 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7f2b-8853-495d-b6cc-d1fa6a82ffc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:51.819841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e7f2b-8853-495d-b6cc-d1fa6a82ffc9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:51.832212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 987/1946] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:51.836942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aaffb-b87a-4c72-95c2-b38673014f8d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:51.847337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9aaffb-b87a-4c72-95c2-b38673014f8d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:51.852325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcbe21-20f3-47bc-8c60-cf47974bbdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:51.853004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcbe21-20f3-47bc-8c60-cf47974bbdd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:51.853271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcbe21-20f3-47bc-8c60-cf47974bbdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:51.853545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dcbe21-20f3-47bc-8c60-cf47974bbdd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:51.854246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcbe21-20f3-47bc-8c60-cf47974bbdd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:51.856196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dcbe21-20f3-47bc-8c60-cf47974bbdd2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:52.071588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 960/1947] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:51 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:52.076280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7f2b-8853-495d-b6cc-d1fa6a82ffc9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:52.086361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e7f2b-8853-495d-b6cc-d1fa6a82ffc9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:52.145741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f5f84-6962-4339-ad4d-53ed22bdc42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:52.146444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f5f84-6962-4339-ad4d-53ed22bdc42c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:52.146730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f5f84-6962-4339-ad4d-53ed22bdc42c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:52.147009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f5f84-6962-4339-ad4d-53ed22bdc42c admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:52.147717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f5f84-6962-4339-ad4d-53ed22bdc42c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:52.149769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f5f84-6962-4339-ad4d-53ed22bdc42c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:52.288121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 988/1948] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:52 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:52.289571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcbe21-20f3-47bc-8c60-cf47974bbdd2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:52.300252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dcbe21-20f3-47bc-8c60-cf47974bbdd2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:52.304767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979396d-ec5c-458e-9eb2-f9c2e08f5c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:52.305429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979396d-ec5c-458e-9eb2-f9c2e08f5c0e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:52.305712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979396d-ec5c-458e-9eb2-f9c2e08f5c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:52.305986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6979396d-ec5c-458e-9eb2-f9c2e08f5c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:52.306714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979396d-ec5c-458e-9eb2-f9c2e08f5c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:52.308629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6979396d-ec5c-458e-9eb2-f9c2e08f5c0e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:52.319634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 961/1949] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:52.327130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f5f84-6962-4339-ad4d-53ed22bdc42c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:52.337202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f5f84-6962-4339-ad4d-53ed22bdc42c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:52.342724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0fc23-8544-4651-b105-d80a78f5e8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:52.343380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0fc23-8544-4651-b105-d80a78f5e8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:52.343660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0fc23-8544-4651-b105-d80a78f5e8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:52.343959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0fc23-8544-4651-b105-d80a78f5e8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:52.344689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0fc23-8544-4651-b105-d80a78f5e8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:52.346271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0fc23-8544-4651-b105-d80a78f5e8a4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:52.356404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 989/1950] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:52.361390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979396d-ec5c-458e-9eb2-f9c2e08f5c0e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:52.371638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6979396d-ec5c-458e-9eb2-f9c2e08f5c0e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:52.376784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4805cab9-792a-4276-8006-82ff73e8b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:52.377660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805cab9-792a-4276-8006-82ff73e8b282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:52.377942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805cab9-792a-4276-8006-82ff73e8b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:52.378221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4805cab9-792a-4276-8006-82ff73e8b282 admin admin] PATH_INFO: `/v3/projects/43dceeb1302841d3a1e741a06259eb15/users/895845af52c94f08baedb6ef90ab7340/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:52.395315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805cab9-792a-4276-8006-82ff73e8b282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43dceeb1302841d3a1e741a06259eb15, user_id=895845af52c94f08baedb6ef90ab7340, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:52.398845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4805cab9-792a-4276-8006-82ff73e8b282 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:52.466382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0fc23-8544-4651-b105-d80a78f5e8a4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:52.468925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-63c0fc23-8544-4651-b105-d80a78f5e8a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:52.518262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 962/1951] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:52 2022] PUT /identity/v3/projects/43dceeb1302841d3a1e741a06259eb15/users/895845af52c94f08baedb6ef90ab7340/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:52.528456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2ed4e-6e0f-4d68-9d68-5f48066a1484 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:52.528924 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2ed4e-6e0f-4d68-9d68-5f48066a1484 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:52.530480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2ed4e-6e0f-4d68-9d68-5f48066a1484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:52.550238 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0fc23-8544-4651-b105-d80a78f5e8a4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:52.559848 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-50a2ed4e-6e0f-4d68-9d68-5f48066a1484 None None] MFA Rules not processed for user `895845af52c94f08baedb6ef90ab7340`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:52.561681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-50a2ed4e-6e0f-4d68-9d68-5f48066a1484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:52.612637 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd80f-facf-4672-a0d4-14589d5b4554 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:52.613300 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd80f-facf-4672-a0d4-14589d5b4554 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:52.613735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd80f-facf-4672-a0d4-14589d5b4554 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:52.614024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230bd80f-facf-4672-a0d4-14589d5b4554 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:52.615888 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-230bd80f-facf-4672-a0d4-14589d5b4554 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:52.661896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 963/1952] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:52.666052 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2ed4e-6e0f-4d68-9d68-5f48066a1484 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:52.701323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd80f-facf-4672-a0d4-14589d5b4554 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:52.702868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230bd80f-facf-4672-a0d4-14589d5b4554 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:52.715087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 990/1953] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:10:52.737388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2ed4e-6e0f-4d68-9d68-5f48066a1484 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:52.742271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c6b3a-09cf-4ca9-9a1d-deb9f39b5cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:52.743219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6b3a-09cf-4ca9-9a1d-deb9f39b5cee admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:52.743219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6b3a-09cf-4ca9-9a1d-deb9f39b5cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:52.743508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c6b3a-09cf-4ca9-9a1d-deb9f39b5cee admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:52.744190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c6b3a-09cf-4ca9-9a1d-deb9f39b5cee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:52.746082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c6b3a-09cf-4ca9-9a1d-deb9f39b5cee admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:52.888485 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 964/1954] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:52 2022] POST /identity/v3/projects => generated 385 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:10:52.892558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd80f-facf-4672-a0d4-14589d5b4554 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:52.902969 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230bd80f-facf-4672-a0d4-14589d5b4554 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:52.978100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d06ed-1dc2-4a35-9131-b356121b6c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:52.978782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d06ed-1dc2-4a35-9131-b356121b6c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:52.979068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d06ed-1dc2-4a35-9131-b356121b6c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:52.979344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d06ed-1dc2-4a35-9131-b356121b6c0a admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:52.980071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d06ed-1dc2-4a35-9131-b356121b6c0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:52.982036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d06ed-1dc2-4a35-9131-b356121b6c0a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:53.139129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 991/1955] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:52 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:10:53.143554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c6b3a-09cf-4ca9-9a1d-deb9f39b5cee admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:53.155791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c6b3a-09cf-4ca9-9a1d-deb9f39b5cee admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:53.161387 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619fae-cbee-4830-b94b-ab65625012f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:53.162094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619fae-cbee-4830-b94b-ab65625012f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:53.162401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619fae-cbee-4830-b94b-ab65625012f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:53.162750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec619fae-cbee-4830-b94b-ab65625012f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:53.163591 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec619fae-cbee-4830-b94b-ab65625012f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:53.165375 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec619fae-cbee-4830-b94b-ab65625012f9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:53.179455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 965/1956] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:10:53.183464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d06ed-1dc2-4a35-9131-b356121b6c0a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:53.192202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:53.196313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d06ed-1dc2-4a35-9131-b356121b6c0a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:53.201868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1a1afd-7aa7-4ab7-a8ac-346f6599b6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:53.208390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a1afd-7aa7-4ab7-a8ac-346f6599b6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:53.208390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a1afd-7aa7-4ab7-a8ac-346f6599b6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:53.208390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1a1afd-7aa7-4ab7-a8ac-346f6599b6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:53.208390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a1afd-7aa7-4ab7-a8ac-346f6599b6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:53.208390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1a1afd-7aa7-4ab7-a8ac-346f6599b6e2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:53.217452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 992/1957] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:53.221804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619fae-cbee-4830-b94b-ab65625012f9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:53.235174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec619fae-cbee-4830-b94b-ab65625012f9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:53.237731 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee0a31-7ff7-47f0-903e-f9f715c87519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:53.239683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee0a31-7ff7-47f0-903e-f9f715c87519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:53.239683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee0a31-7ff7-47f0-903e-f9f715c87519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:53.239683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee0a31-7ff7-47f0-903e-f9f715c87519 admin admin] PATH_INFO: `/v3/projects/4f653d83f9d84e73afa30f2d6e4d3fd0/users/fe9bb30b40db4e46b94e82a64efe0fc5/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:53.255365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee0a31-7ff7-47f0-903e-f9f715c87519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f653d83f9d84e73afa30f2d6e4d3fd0, user_id=fe9bb30b40db4e46b94e82a64efe0fc5, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:53.258365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee0a31-7ff7-47f0-903e-f9f715c87519 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:53.338393 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 966/1958] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:53 2022] PUT /identity/v3/projects/4f653d83f9d84e73afa30f2d6e4d3fd0/users/fe9bb30b40db4e46b94e82a64efe0fc5/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:53.351150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926b5f7-4799-4be1-a190-3abaa2138200 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:53.351446 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926b5f7-4799-4be1-a190-3abaa2138200 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:53.351715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6926b5f7-4799-4be1-a190-3abaa2138200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:53.392853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6926b5f7-4799-4be1-a190-3abaa2138200 None None] MFA Rules not processed for user `fe9bb30b40db4e46b94e82a64efe0fc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:53.394193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6926b5f7-4799-4be1-a190-3abaa2138200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:53.466485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 993/1959] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:53.471540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee0a31-7ff7-47f0-903e-f9f715c87519 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:53.538922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee0a31-7ff7-47f0-903e-f9f715c87519 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:53.545728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbba4b-97a1-462b-ba49-771791786122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:53.546416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbba4b-97a1-462b-ba49-771791786122 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:53.546704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbba4b-97a1-462b-ba49-771791786122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:53.547039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dbba4b-97a1-462b-ba49-771791786122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:53.547942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbba4b-97a1-462b-ba49-771791786122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:53.549934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dbba4b-97a1-462b-ba49-771791786122 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:53.646994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 967/1960] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:53 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:10:53.648265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926b5f7-4799-4be1-a190-3abaa2138200 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:53.664910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6926b5f7-4799-4be1-a190-3abaa2138200 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:53.729714 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2a477-5378-4e28-ac4c-e9c10eff5417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:53.731255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2a477-5378-4e28-ac4c-e9c10eff5417 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:53.731566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2a477-5378-4e28-ac4c-e9c10eff5417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:53.732478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae2a477-5378-4e28-ac4c-e9c10eff5417 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:53.733426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2a477-5378-4e28-ac4c-e9c10eff5417 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:53.735653 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae2a477-5378-4e28-ac4c-e9c10eff5417 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:53.887400 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 994/1961] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:53 2022] POST /identity/v3/users => generated 299 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:53.892291 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbba4b-97a1-462b-ba49-771791786122 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:53.903415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dbba4b-97a1-462b-ba49-771791786122 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:53.917236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f9ab3-13b8-44a6-bfa1-7884e19eb4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:53.917922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9ab3-13b8-44a6-bfa1-7884e19eb4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:53.918207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9ab3-13b8-44a6-bfa1-7884e19eb4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:53.918487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f9ab3-13b8-44a6-bfa1-7884e19eb4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:53.919225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f9ab3-13b8-44a6-bfa1-7884e19eb4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:53.922153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f9ab3-13b8-44a6-bfa1-7884e19eb4c0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:53.933398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 968/1962] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:53.940533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2a477-5378-4e28-ac4c-e9c10eff5417 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:53.951833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae2a477-5378-4e28-ac4c-e9c10eff5417 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:53.956913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab34da-57f7-4b99-87bc-516be6dd90c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:53.957830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab34da-57f7-4b99-87bc-516be6dd90c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:53.958130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab34da-57f7-4b99-87bc-516be6dd90c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:53.958562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ab34da-57f7-4b99-87bc-516be6dd90c4 admin admin] PATH_INFO: `/v3/projects/11ce1ca4462141f692bc5b96cb1aec07/users/cf8ca49300844239ac724376a175a34c/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:53.994469 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab34da-57f7-4b99-87bc-516be6dd90c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ce1ca4462141f692bc5b96cb1aec07, user_id=cf8ca49300844239ac724376a175a34c, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:53.998880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ab34da-57f7-4b99-87bc-516be6dd90c4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:54.093116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 995/1963] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:53 2022] PUT /identity/v3/projects/11ce1ca4462141f692bc5b96cb1aec07/users/cf8ca49300844239ac724376a175a34c/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:54.097517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f9ab3-13b8-44a6-bfa1-7884e19eb4c0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:54.107820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f9ab3-13b8-44a6-bfa1-7884e19eb4c0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:54.169643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e49c7-32eb-4968-911f-5fce2fb866cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:54.170711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e49c7-32eb-4968-911f-5fce2fb866cc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:54.171044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e49c7-32eb-4968-911f-5fce2fb866cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:54.171202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e49c7-32eb-4968-911f-5fce2fb866cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:54.171993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e49c7-32eb-4968-911f-5fce2fb866cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:54.173659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e49c7-32eb-4968-911f-5fce2fb866cc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:54.187406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 969/1964] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:54.191489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab34da-57f7-4b99-87bc-516be6dd90c4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:54.205228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ab34da-57f7-4b99-87bc-516be6dd90c4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:54.209846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8144aa0-b9bc-4340-bb5d-4c3016d48685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:54.210760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144aa0-b9bc-4340-bb5d-4c3016d48685 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:54.211131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144aa0-b9bc-4340-bb5d-4c3016d48685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:54.211573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144aa0-b9bc-4340-bb5d-4c3016d48685 admin admin] PATH_INFO: `/v3/projects/11ce1ca4462141f692bc5b96cb1aec07/users/cf8ca49300844239ac724376a175a34c/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:54.214006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8144aa0-b9bc-4340-bb5d-4c3016d48685 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11ce1ca4462141f692bc5b96cb1aec07, user_id=cf8ca49300844239ac724376a175a34c, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:54.217002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8144aa0-b9bc-4340-bb5d-4c3016d48685 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:54.229601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 996/1965] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:54 2022] PUT /identity/v3/projects/11ce1ca4462141f692bc5b96cb1aec07/users/cf8ca49300844239ac724376a175a34c/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:10:54.241687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b6ec5-fd7e-4762-bc78-f5220d9b5638 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:54.242099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b6ec5-fd7e-4762-bc78-f5220d9b5638 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:54.242516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b6ec5-fd7e-4762-bc78-f5220d9b5638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:54.282125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-055b6ec5-fd7e-4762-bc78-f5220d9b5638 None None] MFA Rules not processed for user `cf8ca49300844239ac724376a175a34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:54.283496 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-055b6ec5-fd7e-4762-bc78-f5220d9b5638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:54.348930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:54.371108 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 970/1966] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:54.383627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8144aa0-b9bc-4340-bb5d-4c3016d48685 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:54.385297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f8144aa0-b9bc-4340-bb5d-4c3016d48685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:54.450275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8144aa0-b9bc-4340-bb5d-4c3016d48685 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:54.454086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d28a58-c7d4-4e59-acb0-20f4d8db1f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:54.454686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d28a58-c7d4-4e59-acb0-20f4d8db1f28 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:54.454967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d28a58-c7d4-4e59-acb0-20f4d8db1f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:54.455242 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d28a58-c7d4-4e59-acb0-20f4d8db1f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:54.465456 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d28a58-c7d4-4e59-acb0-20f4d8db1f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:54.467748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d28a58-c7d4-4e59-acb0-20f4d8db1f28 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:54.478030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 997/1967] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:54 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:55.114142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b6ec5-fd7e-4762-bc78-f5220d9b5638 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:55.115965 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-055b6ec5-fd7e-4762-bc78-f5220d9b5638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:55.183178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b6ec5-fd7e-4762-bc78-f5220d9b5638 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:55.188118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:55.189077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:55.189358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:55.189633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] PATH_INFO: `/v3/users/c93c0bd050c34c388499d31a96a6b4de` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:55.190837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93c0bd050c34c388499d31a96a6b4de)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:55.192824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:55.489643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93c0bd050c34c388499d31a96a6b4de'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:55.501838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93c0bd050c34c388499d31a96a6b4de'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:55.508998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93c0bd050c34c388499d31a96a6b4de'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:55.509695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93c0bd050c34c388499d31a96a6b4de'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:55.510303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93c0bd050c34c388499d31a96a6b4de'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:55.648190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 971/1968] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:10:55 2022] DELETE /identity/v3/users/c93c0bd050c34c388499d31a96a6b4de => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:55.652799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb95c0-e3ca-4a48-a5ea-45ae1e71c7ea None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:55.679564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb95c0-e3ca-4a48-a5ea-45ae1e71c7ea None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:55.679564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbb95c0-e3ca-4a48-a5ea-45ae1e71c7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:55.679564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-bcbb95c0-e3ca-4a48-a5ea-45ae1e71c7ea None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:55.679564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bcbb95c0-e3ca-4a48-a5ea-45ae1e71c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:55.758371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 998/1969] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:55.769737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:55.771266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:55.845638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0784c29-b4a5-448e-b7fd-243d364d1e35 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:55.849403 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e7ec1-b811-47f8-8a45-b8f729d1bbc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:55.850071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e7ec1-b811-47f8-8a45-b8f729d1bbc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:55.850340 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e7ec1-b811-47f8-8a45-b8f729d1bbc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:55.850613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e7ec1-b811-47f8-8a45-b8f729d1bbc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:55.860143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e7ec1-b811-47f8-8a45-b8f729d1bbc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:55.861750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e7ec1-b811-47f8-8a45-b8f729d1bbc6 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:55.871687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 972/1970] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:56.098798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb95c0-e3ca-4a48-a5ea-45ae1e71c7ea None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:56.100419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bcbb95c0-e3ca-4a48-a5ea-45ae1e71c7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:56.151517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:56.195909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbb95c0-e3ca-4a48-a5ea-45ae1e71c7ea None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:56.201179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68357824-82b0-40a2-9c7e-ce22a6f6efee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:56.201905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68357824-82b0-40a2-9c7e-ce22a6f6efee service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:56.202194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68357824-82b0-40a2-9c7e-ce22a6f6efee service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:56.202471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68357824-82b0-40a2-9c7e-ce22a6f6efee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:56.204462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-68357824-82b0-40a2-9c7e-ce22a6f6efee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:56.282960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68357824-82b0-40a2-9c7e-ce22a6f6efee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:56.284435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68357824-82b0-40a2-9c7e-ce22a6f6efee service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:56.295890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 999/1971] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:56.429103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e7ec1-b811-47f8-8a45-b8f729d1bbc6 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:56.430747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb7e7ec1-b811-47f8-8a45-b8f729d1bbc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:56.469320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e7ec1-b811-47f8-8a45-b8f729d1bbc6 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:56.476020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:56.477146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:56.478097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:56.478454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] PATH_INFO: `/v3/projects/4ac8476adb054207954d5f4d9669d987` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:56.485269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ac8476adb054207954d5f4d9669d987)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:56.485269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:56.624969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ac8476adb054207954d5f4d9669d987', 'request_id': 'req-5b7659fc-920e-4b75-9d98-b8213d6d7947'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:56.630476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ac8476adb054207954d5f4d9669d987', 'request_id': 'req-5b7659fc-920e-4b75-9d98-b8213d6d7947'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:56.725997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ac8476adb054207954d5f4d9669d987', 'request_id': 'req-5b7659fc-920e-4b75-9d98-b8213d6d7947'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:56.739100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] The token cache is being invalidate because project 4ac8476adb054207954d5f4d9669d987 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:10:56.739398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:56.740160 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b7659fc-920e-4b75-9d98-b8213d6d7947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:10:56.741864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 973/1972] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:10:56 2022] DELETE /identity/v3/projects/4ac8476adb054207954d5f4d9669d987 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:56.746851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082fff8-e9fa-47e8-b02a-fd1403139f3a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:56.747331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082fff8-e9fa-47e8-b02a-fd1403139f3a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:56.747523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082fff8-e9fa-47e8-b02a-fd1403139f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:56.775548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f082fff8-e9fa-47e8-b02a-fd1403139f3a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:56.777139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f082fff8-e9fa-47e8-b02a-fd1403139f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:56.818976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:56.843467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1000/1973] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:56.851754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0627d7-65ab-4c93-9926-3faadc06ea6b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:56.852132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0627d7-65ab-4c93-9926-3faadc06ea6b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:56.852512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0627d7-65ab-4c93-9926-3faadc06ea6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:56.871627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fc0627d7-65ab-4c93-9926-3faadc06ea6b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:56.872933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fc0627d7-65ab-4c93-9926-3faadc06ea6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:56.884915 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 974/1974] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:10:56.893064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082fff8-e9fa-47e8-b02a-fd1403139f3a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:56.905192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082fff8-e9fa-47e8-b02a-fd1403139f3a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:56.910297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe8c34-5fb6-4a09-95b1-616ab8c5ec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:56.911160 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8c34-5fb6-4a09-95b1-616ab8c5ec1e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:56.911695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8c34-5fb6-4a09-95b1-616ab8c5ec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:56.912108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfe8c34-5fb6-4a09-95b1-616ab8c5ec1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:56.912759 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe8c34-5fb6-4a09-95b1-616ab8c5ec1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:10:56.913082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe8c34-5fb6-4a09-95b1-616ab8c5ec1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:56.914686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfe8c34-5fb6-4a09-95b1-616ab8c5ec1e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:56.927070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1001/1975] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:10:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:10:56.932013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0627d7-65ab-4c93-9926-3faadc06ea6b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:56.942389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0627d7-65ab-4c93-9926-3faadc06ea6b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:56.947464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1109d70-30b5-4840-b373-0f84f20edd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:56.948274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109d70-30b5-4840-b373-0f84f20edd01 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:56.948634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109d70-30b5-4840-b373-0f84f20edd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:56.948983 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109d70-30b5-4840-b373-0f84f20edd01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:56.949769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1109d70-30b5-4840-b373-0f84f20edd01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:56.952969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1109d70-30b5-4840-b373-0f84f20edd01 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:57.103436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 975/1976] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:10:56 2022] POST /identity/v3/projects => generated 375 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:57.109698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe8c34-5fb6-4a09-95b1-616ab8c5ec1e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:57.121233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfe8c34-5fb6-4a09-95b1-616ab8c5ec1e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:57.187679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbe178-f422-448f-8107-e8f8e654877c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:57.188390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbe178-f422-448f-8107-e8f8e654877c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:57.189532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbe178-f422-448f-8107-e8f8e654877c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:57.189532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fbe178-f422-448f-8107-e8f8e654877c admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:57.189851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbe178-f422-448f-8107-e8f8e654877c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:57.191793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fbe178-f422-448f-8107-e8f8e654877c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:57.283812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1002/1977] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:10:57 2022] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:10:57.290360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1109d70-30b5-4840-b373-0f84f20edd01 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:57.317970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1109d70-30b5-4840-b373-0f84f20edd01 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:57.335238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb932d-93b9-4500-ad22-76a45cb32758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:57.335238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb932d-93b9-4500-ad22-76a45cb32758 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:57.335238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb932d-93b9-4500-ad22-76a45cb32758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:57.335238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb932d-93b9-4500-ad22-76a45cb32758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:57.335735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb932d-93b9-4500-ad22-76a45cb32758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:57.356062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb932d-93b9-4500-ad22-76a45cb32758 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:57.356062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 976/1978] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:57.360303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbe178-f422-448f-8107-e8f8e654877c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:57.371296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fbe178-f422-448f-8107-e8f8e654877c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:57.377730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d7d76-f26d-4ca3-94a0-9eaff2b4cc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:57.378468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d7d76-f26d-4ca3-94a0-9eaff2b4cc3f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:57.385291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d7d76-f26d-4ca3-94a0-9eaff2b4cc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:57.385291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d7d76-f26d-4ca3-94a0-9eaff2b4cc3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:57.385291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d7d76-f26d-4ca3-94a0-9eaff2b4cc3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:57.385291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450d7d76-f26d-4ca3-94a0-9eaff2b4cc3f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:57.393209 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1003/1979] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:10:57.397711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb932d-93b9-4500-ad22-76a45cb32758 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:57.408845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb932d-93b9-4500-ad22-76a45cb32758 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:57.413899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529829-a12d-4f56-a9ee-5071c3b51f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:57.414774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529829-a12d-4f56-a9ee-5071c3b51f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:57.415060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529829-a12d-4f56-a9ee-5071c3b51f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:57.415337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43529829-a12d-4f56-a9ee-5071c3b51f39 admin admin] PATH_INFO: `/v3/projects/c8cd1cac3d354220965b74d9e0953fe1/users/1b16ee911cf3485bb96415a789b4976d/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:57.431221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43529829-a12d-4f56-a9ee-5071c3b51f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cd1cac3d354220965b74d9e0953fe1, user_id=1b16ee911cf3485bb96415a789b4976d, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:57.433985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43529829-a12d-4f56-a9ee-5071c3b51f39 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:57.469793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:57.533214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 977/1980] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:10:57 2022] PUT /identity/v3/projects/c8cd1cac3d354220965b74d9e0953fe1/users/1b16ee911cf3485bb96415a789b4976d/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:10:57.545482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3280e-eab3-46c0-8fd3-eee6fcc7d0e2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:57.545922 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3280e-eab3-46c0-8fd3-eee6fcc7d0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:57.546407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3280e-eab3-46c0-8fd3-eee6fcc7d0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:57.576707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f8e3280e-eab3-46c0-8fd3-eee6fcc7d0e2 None None] MFA Rules not processed for user `1b16ee911cf3485bb96415a789b4976d`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:10:57.577940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f8e3280e-eab3-46c0-8fd3-eee6fcc7d0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:57.651870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1004/1981] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:10:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:10:57.663779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529829-a12d-4f56-a9ee-5071c3b51f39 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:10:57.665623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-43529829-a12d-4f56-a9ee-5071c3b51f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:10:57.681307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:57.739710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43529829-a12d-4f56-a9ee-5071c3b51f39 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:10:57.745537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420160d3-615d-469d-ba1a-228287a9bae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:10:57.746603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420160d3-615d-469d-ba1a-228287a9bae6 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:10:57.747092 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420160d3-615d-469d-ba1a-228287a9bae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:10:57.748699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420160d3-615d-469d-ba1a-228287a9bae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:10:57.762835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420160d3-615d-469d-ba1a-228287a9bae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:10:57.765923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420160d3-615d-469d-ba1a-228287a9bae6 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:10:57.781885 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 978/1982] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:10:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:10:58.967682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:10:59.178012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:01.458725 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:01.681329 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:02.261957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3280e-eab3-46c0-8fd3-eee6fcc7d0e2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:02.290786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3280e-eab3-46c0-8fd3-eee6fcc7d0e2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:02.298518 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57daf190-0334-41ba-a369-0a690386a483 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:02.300533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daf190-0334-41ba-a369-0a690386a483 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:02.301055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daf190-0334-41ba-a369-0a690386a483 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:02.301767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57daf190-0334-41ba-a369-0a690386a483 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:02.304384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-57daf190-0334-41ba-a369-0a690386a483 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:02.367451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:02.376256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57daf190-0334-41ba-a369-0a690386a483 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:02.377809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57daf190-0334-41ba-a369-0a690386a483 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:02.387374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1005/1983] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:02.715635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:02.795708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf022-528d-4bcd-88ce-d2e1c8e5d481 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:02.795708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf022-528d-4bcd-88ce-d2e1c8e5d481 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:02.795708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadf022-528d-4bcd-88ce-d2e1c8e5d481 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:02.795708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 979/1984] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:11:02.803039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b4517-9070-472a-ba3e-e7119b08e677 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:02.803348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b4517-9070-472a-ba3e-e7119b08e677 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:02.803856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644b4517-9070-472a-ba3e-e7119b08e677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:02.831062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-644b4517-9070-472a-ba3e-e7119b08e677 None None] MFA Rules not processed for user `4e52a3464d8f4a3fa16a102336a4bbf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:02.832586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-644b4517-9070-472a-ba3e-e7119b08e677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:02.907217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1006/1985] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:11:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:02.916835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadf022-528d-4bcd-88ce-d2e1c8e5d481 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:02.918675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8eadf022-528d-4bcd-88ce-d2e1c8e5d481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:02.936455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadf022-528d-4bcd-88ce-d2e1c8e5d481 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:02.941891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f291d6-c988-4a9d-bf9a-9357877b7b2c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e52a3464d8f4a3fa16a102336a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:02.942542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f291d6-c988-4a9d-bf9a-9357877b7b2c service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:02.943003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f291d6-c988-4a9d-bf9a-9357877b7b2c service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:02.943285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f291d6-c988-4a9d-bf9a-9357877b7b2c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:02.954300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f291d6-c988-4a9d-bf9a-9357877b7b2c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:02.955944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f291d6-c988-4a9d-bf9a-9357877b7b2c service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:02.975726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 980/1986] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:02.979744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b4517-9070-472a-ba3e-e7119b08e677 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:02.981398 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-644b4517-9070-472a-ba3e-e7119b08e677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:03.061530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644b4517-9070-472a-ba3e-e7119b08e677 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:03.067207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:03.068262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:03.068642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:03.068999 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] PATH_INFO: `/v3/users/9dbbfc0772104ed6af5c8cf8d406f64b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:03.070289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dbbfc0772104ed6af5c8cf8d406f64b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:03.072411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:03.351016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dbbfc0772104ed6af5c8cf8d406f64b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:03.457768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dbbfc0772104ed6af5c8cf8d406f64b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:03.465797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dbbfc0772104ed6af5c8cf8d406f64b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:03.466990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dbbfc0772104ed6af5c8cf8d406f64b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:03.483468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5e4c6294-a3a4-4dfb-8947-5ff182649c33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dbbfc0772104ed6af5c8cf8d406f64b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:03.489740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1007/1987] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:02 2022] DELETE /identity/v3/users/9dbbfc0772104ed6af5c8cf8d406f64b => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:03.831902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f291d6-c988-4a9d-bf9a-9357877b7b2c service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:03.845577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f291d6-c988-4a9d-bf9a-9357877b7b2c service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:03.905719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:03.906615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:03.908871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:03.908871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] PATH_INFO: `/v3/projects/eacd694fb0c9467ca558e578151700b4` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:03.908871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eacd694fb0c9467ca558e578151700b4)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:03.910468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:04.127831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eacd694fb0c9467ca558e578151700b4', 'request_id': 'req-567e55e5-5404-40c2-9c69-3fefa562b3d0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:04.135255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eacd694fb0c9467ca558e578151700b4', 'request_id': 'req-567e55e5-5404-40c2-9c69-3fefa562b3d0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:04.254253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eacd694fb0c9467ca558e578151700b4', 'request_id': 'req-567e55e5-5404-40c2-9c69-3fefa562b3d0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:04.266729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] The token cache is being invalidate because project eacd694fb0c9467ca558e578151700b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:04.267019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:04.267674 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-567e55e5-5404-40c2-9c69-3fefa562b3d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:04.274715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 981/1988] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:03 2022] DELETE /identity/v3/projects/eacd694fb0c9467ca558e578151700b4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:04.277281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8b7c5-ed0c-4f39-b738-a7e215714340 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:04.277737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8b7c5-ed0c-4f39-b738-a7e215714340 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:04.278123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d8b7c5-ed0c-4f39-b738-a7e215714340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:04.304490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b7d8b7c5-ed0c-4f39-b738-a7e215714340 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:04.305980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b7d8b7c5-ed0c-4f39-b738-a7e215714340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:04.383516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1008/1989] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:04.392853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9350d-bf06-4797-92ab-4ee85f94fbf4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:04.393159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9350d-bf06-4797-92ab-4ee85f94fbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:04.393431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9350d-bf06-4797-92ab-4ee85f94fbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:04.412800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9ea9350d-bf06-4797-92ab-4ee85f94fbf4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:04.414018 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9ea9350d-bf06-4797-92ab-4ee85f94fbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:04.422730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 982/1990] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:04.427120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8b7c5-ed0c-4f39-b738-a7e215714340 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:04.437247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d8b7c5-ed0c-4f39-b738-a7e215714340 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:04.442585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f0bfe-15ec-405c-a06d-24f18b26ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:04.443304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0bfe-15ec-405c-a06d-24f18b26ffb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:04.443605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0bfe-15ec-405c-a06d-24f18b26ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:04.443879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f0bfe-15ec-405c-a06d-24f18b26ffb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:04.446844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f0bfe-15ec-405c-a06d-24f18b26ffb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:04.446844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f0bfe-15ec-405c-a06d-24f18b26ffb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:04.446844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f0bfe-15ec-405c-a06d-24f18b26ffb6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:04.461508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1009/1991] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:04.468337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9350d-bf06-4797-92ab-4ee85f94fbf4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:04.478437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9350d-bf06-4797-92ab-4ee85f94fbf4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:04.486382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ddb95-8023-4a20-aa2f-cdc493e15260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:04.487050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ddb95-8023-4a20-aa2f-cdc493e15260 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:04.487468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ddb95-8023-4a20-aa2f-cdc493e15260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:04.487648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ddb95-8023-4a20-aa2f-cdc493e15260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:04.488405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ddb95-8023-4a20-aa2f-cdc493e15260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:04.490356 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ddb95-8023-4a20-aa2f-cdc493e15260 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:04.569936 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:04.611408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 983/1992] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:04 2022] POST /identity/v3/projects => generated 383 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:11:04.621834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f0bfe-15ec-405c-a06d-24f18b26ffb6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:04.634345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f0bfe-15ec-405c-a06d-24f18b26ffb6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:04.699348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1556b-e459-47f8-9d34-dbe4b778a551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:04.700083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1556b-e459-47f8-9d34-dbe4b778a551 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:04.701076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1556b-e459-47f8-9d34-dbe4b778a551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:04.701359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1556b-e459-47f8-9d34-dbe4b778a551 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:04.702064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1556b-e459-47f8-9d34-dbe4b778a551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:04.704201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1556b-e459-47f8-9d34-dbe4b778a551 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:04.796044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1010/1993] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:04 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:04.800223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ddb95-8023-4a20-aa2f-cdc493e15260 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:04.813549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ddb95-8023-4a20-aa2f-cdc493e15260 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:04.819366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c5d22-ad39-40e2-8337-2d14956309fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:04.820067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c5d22-ad39-40e2-8337-2d14956309fb admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:04.820357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c5d22-ad39-40e2-8337-2d14956309fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:04.820635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c5d22-ad39-40e2-8337-2d14956309fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:04.821389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c5d22-ad39-40e2-8337-2d14956309fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:04.823081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c5d22-ad39-40e2-8337-2d14956309fb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:04.824575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:04.836712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 984/1994] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:04.841973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1556b-e459-47f8-9d34-dbe4b778a551 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:04.856584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1556b-e459-47f8-9d34-dbe4b778a551 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:04.867544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc67a4-a82b-43c6-8b43-90f6a6b11b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:04.867544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc67a4-a82b-43c6-8b43-90f6a6b11b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:04.867544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc67a4-a82b-43c6-8b43-90f6a6b11b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:04.867544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc67a4-a82b-43c6-8b43-90f6a6b11b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:04.868092 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc67a4-a82b-43c6-8b43-90f6a6b11b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:04.868092 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc67a4-a82b-43c6-8b43-90f6a6b11b52 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:04.881527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1011/1995] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:04 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:04.886004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c5d22-ad39-40e2-8337-2d14956309fb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:04.897260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c5d22-ad39-40e2-8337-2d14956309fb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:04.903113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f03000-ff55-414e-b166-445992dda2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:04.904165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f03000-ff55-414e-b166-445992dda2e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:04.904649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f03000-ff55-414e-b166-445992dda2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:04.904835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f03000-ff55-414e-b166-445992dda2e5 admin admin] PATH_INFO: `/v3/projects/12777fb994a34ea7a3320acd7cd28474/users/111b06722ed54bcaab771e4788015cb4/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:04.922660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f03000-ff55-414e-b166-445992dda2e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12777fb994a34ea7a3320acd7cd28474, user_id=111b06722ed54bcaab771e4788015cb4, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:04.925701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f03000-ff55-414e-b166-445992dda2e5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:05.065477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 985/1996] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:04 2022] PUT /identity/v3/projects/12777fb994a34ea7a3320acd7cd28474/users/111b06722ed54bcaab771e4788015cb4/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:05.070840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361e5ba-9aa5-4d93-b0cc-8b419122c38a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:05.071122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361e5ba-9aa5-4d93-b0cc-8b419122c38a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:05.071393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2361e5ba-9aa5-4d93-b0cc-8b419122c38a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:05.088762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2361e5ba-9aa5-4d93-b0cc-8b419122c38a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:05.090003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2361e5ba-9aa5-4d93-b0cc-8b419122c38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:05.156107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1012/1997] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:05.163820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f03000-ff55-414e-b166-445992dda2e5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:05.166645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b9f03000-ff55-414e-b166-445992dda2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:05.222958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f03000-ff55-414e-b166-445992dda2e5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:05.226695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c424e7-38e8-41f0-9199-e4be8b1f451f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:05.227343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c424e7-38e8-41f0-9199-e4be8b1f451f service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:05.227626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c424e7-38e8-41f0-9199-e4be8b1f451f service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:05.227902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c424e7-38e8-41f0-9199-e4be8b1f451f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:05.237788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c424e7-38e8-41f0-9199-e4be8b1f451f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:05.239228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c424e7-38e8-41f0-9199-e4be8b1f451f service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:05.250192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 986/1998] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:05.281190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361e5ba-9aa5-4d93-b0cc-8b419122c38a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:05.282711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2361e5ba-9aa5-4d93-b0cc-8b419122c38a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:05.298636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2361e5ba-9aa5-4d93-b0cc-8b419122c38a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:05.303829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:05.304868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:05.305219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:05.305557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] PATH_INFO: `/v3/users/ec1e0868ec9f46a08e14de0c17743682` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:05.306943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1e0868ec9f46a08e14de0c17743682)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:05.309021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:05.644997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1e0868ec9f46a08e14de0c17743682'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:05.772642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1e0868ec9f46a08e14de0c17743682'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:05.783907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1e0868ec9f46a08e14de0c17743682'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:05.783907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1e0868ec9f46a08e14de0c17743682'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:05.794686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1e0868ec9f46a08e14de0c17743682'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:05.806871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1013/1999] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:05 2022] DELETE /identity/v3/users/ec1e0868ec9f46a08e14de0c17743682 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:05.816832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1e6d9-07b7-4b7e-bfb8-725efa1d9e69 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:05.816832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1e6d9-07b7-4b7e-bfb8-725efa1d9e69 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:05.816832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc1e6d9-07b7-4b7e-bfb8-725efa1d9e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:05.832369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5bc1e6d9-07b7-4b7e-bfb8-725efa1d9e69 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:05.834605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5bc1e6d9-07b7-4b7e-bfb8-725efa1d9e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:05.837573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:05.899203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 987/2000] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:05.911050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:05.912827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:05.987416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037926b0-857d-4c3e-88d2-b992f05d9056 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:05.991327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbe6dc-2578-4d1c-bcd8-d6d051f99b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:05.992040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe6dc-2578-4d1c-bcd8-d6d051f99b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:05.992327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe6dc-2578-4d1c-bcd8-d6d051f99b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:05.992613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbe6dc-2578-4d1c-bcd8-d6d051f99b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:06.011744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe6dc-2578-4d1c-bcd8-d6d051f99b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:06.013800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbbe6dc-2578-4d1c-bcd8-d6d051f99b7b service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:06.024044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1014/2001] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:06.598098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1e6d9-07b7-4b7e-bfb8-725efa1d9e69 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:06.599395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5bc1e6d9-07b7-4b7e-bfb8-725efa1d9e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:06.614374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc1e6d9-07b7-4b7e-bfb8-725efa1d9e69 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:06.620923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:06.621857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:06.622187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:06.622985 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] PATH_INFO: `/v3/projects/24bc7ed2f01447678c32659ed429a846` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:06.626589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] RBAC: Authorizing `identity:delete_project(project_id=24bc7ed2f01447678c32659ed429a846)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:06.626589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:06.795872 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24bc7ed2f01447678c32659ed429a846', 'request_id': 'req-b1397c41-12f9-4a80-a63c-37397bbdd37d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:06.801412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24bc7ed2f01447678c32659ed429a846', 'request_id': 'req-b1397c41-12f9-4a80-a63c-37397bbdd37d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:06.944689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24bc7ed2f01447678c32659ed429a846', 'request_id': 'req-b1397c41-12f9-4a80-a63c-37397bbdd37d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:06.959121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] The token cache is being invalidate because project 24bc7ed2f01447678c32659ed429a846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:06.959416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:06.960146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b1397c41-12f9-4a80-a63c-37397bbdd37d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:06.962247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 988/2002] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:06 2022] DELETE /identity/v3/projects/24bc7ed2f01447678c32659ed429a846 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:06.967904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6348c-8907-4a72-ab61-b8b4b4f14e33 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:06.968445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6348c-8907-4a72-ab61-b8b4b4f14e33 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:06.968554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6348c-8907-4a72-ab61-b8b4b4f14e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:06.997874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-40a6348c-8907-4a72-ab61-b8b4b4f14e33 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:07.018371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-40a6348c-8907-4a72-ab61-b8b4b4f14e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:07.099569 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1015/2003] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:07.107468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:07.109322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2aef-e674-4b27-b660-ff6c0358d534 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:07.109578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2aef-e674-4b27-b660-ff6c0358d534 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:07.109853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fb2aef-e674-4b27-b660-ff6c0358d534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:07.129309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-10fb2aef-e674-4b27-b660-ff6c0358d534 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:07.130717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-10fb2aef-e674-4b27-b660-ff6c0358d534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:07.139877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 989/2004] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:07.144849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6348c-8907-4a72-ab61-b8b4b4f14e33 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:07.156542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6348c-8907-4a72-ab61-b8b4b4f14e33 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:07.161877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb570ee-c115-45fd-ada8-6f98b519f3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:07.162552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb570ee-c115-45fd-ada8-6f98b519f3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:07.162839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb570ee-c115-45fd-ada8-6f98b519f3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:07.163118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb570ee-c115-45fd-ada8-6f98b519f3d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:07.163908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb570ee-c115-45fd-ada8-6f98b519f3d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:07.164276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb570ee-c115-45fd-ada8-6f98b519f3d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:07.165992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb570ee-c115-45fd-ada8-6f98b519f3d1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:07.185025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1016/2005] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:07.189797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb2aef-e674-4b27-b660-ff6c0358d534 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:07.204987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fb2aef-e674-4b27-b660-ff6c0358d534 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:07.211030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873e556-2e13-464f-94bb-7c32790bc6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:07.218132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873e556-2e13-464f-94bb-7c32790bc6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:07.218132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873e556-2e13-464f-94bb-7c32790bc6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:07.218132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873e556-2e13-464f-94bb-7c32790bc6a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:07.218132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873e556-2e13-464f-94bb-7c32790bc6a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:07.218132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873e556-2e13-464f-94bb-7c32790bc6a3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:07.372250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 990/2006] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:07 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:07.379466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb570ee-c115-45fd-ada8-6f98b519f3d1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:07.379640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873e556-2e13-464f-94bb-7c32790bc6a3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:07.381614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4873e556-2e13-464f-94bb-7c32790bc6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:07.409398 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb570ee-c115-45fd-ada8-6f98b519f3d1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:07.488862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873e556-2e13-464f-94bb-7c32790bc6a3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:07.494362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:07.495247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:07.495559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:07.495817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] PATH_INFO: `/v3/users/895845af52c94f08baedb6ef90ab7340` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:07.498337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=895845af52c94f08baedb6ef90ab7340)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:07.500641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:07.521164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82f3e-b30a-4bc1-b5cc-f04ed32d0235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:07.523619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82f3e-b30a-4bc1-b5cc-f04ed32d0235 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:07.523619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82f3e-b30a-4bc1-b5cc-f04ed32d0235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:07.523619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b82f3e-b30a-4bc1-b5cc-f04ed32d0235 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:07.523619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b82f3e-b30a-4bc1-b5cc-f04ed32d0235 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:07.526483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b82f3e-b30a-4bc1-b5cc-f04ed32d0235 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:07.644490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1017/2007] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:07 2022] POST /identity/v3/users => generated 281 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:11:07.648692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82f3e-b30a-4bc1-b5cc-f04ed32d0235 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:07.670219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b82f3e-b30a-4bc1-b5cc-f04ed32d0235 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:07.676535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4c7ad-7cd3-45a9-aa5c-6ef98d39c576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:07.677557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4c7ad-7cd3-45a9-aa5c-6ef98d39c576 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:07.677869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4c7ad-7cd3-45a9-aa5c-6ef98d39c576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:07.678150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4c7ad-7cd3-45a9-aa5c-6ef98d39c576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:07.678895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4c7ad-7cd3-45a9-aa5c-6ef98d39c576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:07.680897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4c7ad-7cd3-45a9-aa5c-6ef98d39c576 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:07.697575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1018/2008] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:11:07.701845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4c7ad-7cd3-45a9-aa5c-6ef98d39c576 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:07.719129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4c7ad-7cd3-45a9-aa5c-6ef98d39c576 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:07.719468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24896b3e-0c81-443d-88f4-395c2cfef485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:07.720536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24896b3e-0c81-443d-88f4-395c2cfef485 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:07.720792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24896b3e-0c81-443d-88f4-395c2cfef485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:07.721080 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24896b3e-0c81-443d-88f4-395c2cfef485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:07.721827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24896b3e-0c81-443d-88f4-395c2cfef485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:07.723474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24896b3e-0c81-443d-88f4-395c2cfef485 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:07.740129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1019/2009] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:07.742236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24896b3e-0c81-443d-88f4-395c2cfef485 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:07.754183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24896b3e-0c81-443d-88f4-395c2cfef485 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:07.759408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce64cf2-9e46-4215-a025-c2f587d201f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:07.760287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce64cf2-9e46-4215-a025-c2f587d201f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:07.760703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce64cf2-9e46-4215-a025-c2f587d201f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:07.760865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce64cf2-9e46-4215-a025-c2f587d201f5 admin admin] PATH_INFO: `/v3/projects/57a64cd6a9284bc080eaac5f8e1c62e6/users/c77e1d5a6c034fb599b74f51d8870500/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:07.794877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce64cf2-9e46-4215-a025-c2f587d201f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57a64cd6a9284bc080eaac5f8e1c62e6, user_id=c77e1d5a6c034fb599b74f51d8870500, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:07.799848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce64cf2-9e46-4215-a025-c2f587d201f5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:07.839427 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '895845af52c94f08baedb6ef90ab7340'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:07.866616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '895845af52c94f08baedb6ef90ab7340'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:07.886070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1020/2010] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:07 2022] PUT /identity/v3/projects/57a64cd6a9284bc080eaac5f8e1c62e6/users/c77e1d5a6c034fb599b74f51d8870500/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:07.897992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65a7dc-922d-48f2-88ac-b128ccff2f83 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:07.898420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65a7dc-922d-48f2-88ac-b128ccff2f83 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:07.898700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65a7dc-922d-48f2-88ac-b128ccff2f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:07.901081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '895845af52c94f08baedb6ef90ab7340'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:07.904868 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '895845af52c94f08baedb6ef90ab7340'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:07.905665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-db93492c-1c2f-4e5a-af4c-6ab7a05a4d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '895845af52c94f08baedb6ef90ab7340'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:07.937665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3d65a7dc-922d-48f2-88ac-b128ccff2f83 None None] MFA Rules not processed for user `c77e1d5a6c034fb599b74f51d8870500`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:07.939117 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3d65a7dc-922d-48f2-88ac-b128ccff2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:08.036360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 991/2011] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:07 2022] DELETE /identity/v3/users/895845af52c94f08baedb6ef90ab7340 => generated 0 bytes in 657 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:08.039968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1021/2012] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:08.042140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b529-c09c-476e-96f4-c5e0c3354ce8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:08.042713 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b529-c09c-476e-96f4-c5e0c3354ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:08.042994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032b529-c09c-476e-96f4-c5e0c3354ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:08.080656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d032b529-c09c-476e-96f4-c5e0c3354ce8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:08.082380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d032b529-c09c-476e-96f4-c5e0c3354ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:08.121049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65a7dc-922d-48f2-88ac-b128ccff2f83 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:08.122590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3d65a7dc-922d-48f2-88ac-b128ccff2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:08.184216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 992/2013] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:08.194473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032b529-c09c-476e-96f4-c5e0c3354ce8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:08.196626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d032b529-c09c-476e-96f4-c5e0c3354ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:08.233420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65a7dc-922d-48f2-88ac-b128ccff2f83 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:08.293662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032b529-c09c-476e-96f4-c5e0c3354ce8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:08.312253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c983a-a2b6-4e03-9f5a-5c8345b34bd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:08.321084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c983a-a2b6-4e03-9f5a-5c8345b34bd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:08.321856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c983a-a2b6-4e03-9f5a-5c8345b34bd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:08.322353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c983a-a2b6-4e03-9f5a-5c8345b34bd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:08.335871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c983a-a2b6-4e03-9f5a-5c8345b34bd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:08.338197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c983a-a2b6-4e03-9f5a-5c8345b34bd7 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:08.342553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6902ef1a-8e00-4c8e-9975-b7477f92edcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:08.343570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902ef1a-8e00-4c8e-9975-b7477f92edcc service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:08.344140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902ef1a-8e00-4c8e-9975-b7477f92edcc service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:08.344450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6902ef1a-8e00-4c8e-9975-b7477f92edcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:08.361958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 993/2014] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:11:08.472840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902ef1a-8e00-4c8e-9975-b7477f92edcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:08.474536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6902ef1a-8e00-4c8e-9975-b7477f92edcc service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:08.489218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1022/2015] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:08.506000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c983a-a2b6-4e03-9f5a-5c8345b34bd7 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:08.507535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bf4c983a-a2b6-4e03-9f5a-5c8345b34bd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:08.522128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c983a-a2b6-4e03-9f5a-5c8345b34bd7 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:08.532896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:08.533841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:08.534130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:08.534407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] PATH_INFO: `/v3/users/c77e1d5a6c034fb599b74f51d8870500` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:08.542245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77e1d5a6c034fb599b74f51d8870500)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:08.544334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:08.758522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77e1d5a6c034fb599b74f51d8870500'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:08.772813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77e1d5a6c034fb599b74f51d8870500'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:08.786947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77e1d5a6c034fb599b74f51d8870500'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:08.788408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77e1d5a6c034fb599b74f51d8870500'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:08.789233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77e1d5a6c034fb599b74f51d8870500'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:08.875546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:08.953198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 994/2016] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:08 2022] DELETE /identity/v3/users/c77e1d5a6c034fb599b74f51d8870500 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:08.958162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f335fdc-0d88-49ee-ad16-1886e3fc5b29 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:08.958162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f335fdc-0d88-49ee-ad16-1886e3fc5b29 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:08.958580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f335fdc-0d88-49ee-ad16-1886e3fc5b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:08.992834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4f335fdc-0d88-49ee-ad16-1886e3fc5b29 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:08.993194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4f335fdc-0d88-49ee-ad16-1886e3fc5b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:09.069972 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1023/2017] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:09.080773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:09.082366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:09.149380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e681f9-aed0-4c0e-9211-82544bfcf2e1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:09.154456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8491d-daa9-42f5-9d18-b0ba064768f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:09.155430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8491d-daa9-42f5-9d18-b0ba064768f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:09.155861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8491d-daa9-42f5-9d18-b0ba064768f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:09.156306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf8491d-daa9-42f5-9d18-b0ba064768f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:09.173160 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8491d-daa9-42f5-9d18-b0ba064768f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:09.173160 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf8491d-daa9-42f5-9d18-b0ba064768f4 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:09.195075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 995/2018] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:09.217131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f335fdc-0d88-49ee-ad16-1886e3fc5b29 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:09.218802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4f335fdc-0d88-49ee-ad16-1886e3fc5b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:09.233493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f335fdc-0d88-49ee-ad16-1886e3fc5b29 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:09.240534 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:09.248215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:09.248215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:09.248215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] PATH_INFO: `/v3/projects/43dceeb1302841d3a1e741a06259eb15` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:09.248215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43dceeb1302841d3a1e741a06259eb15)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:09.248215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:09.427001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43dceeb1302841d3a1e741a06259eb15', 'request_id': 'req-a684e9ee-21c6-4bea-8f63-619a10623dd4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:09.435724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43dceeb1302841d3a1e741a06259eb15', 'request_id': 'req-a684e9ee-21c6-4bea-8f63-619a10623dd4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:09.555601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43dceeb1302841d3a1e741a06259eb15', 'request_id': 'req-a684e9ee-21c6-4bea-8f63-619a10623dd4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:09.581708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] The token cache is being invalidate because project 43dceeb1302841d3a1e741a06259eb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:09.582178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:09.583315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:09.586587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1024/2019] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:09 2022] DELETE /identity/v3/projects/43dceeb1302841d3a1e741a06259eb15 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:09.593203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8491d-daa9-42f5-9d18-b0ba064768f4 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:09.608016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf8491d-daa9-42f5-9d18-b0ba064768f4 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:09.690693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:09.691849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:09.692423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:09.694889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] PATH_INFO: `/v3/users/fe9bb30b40db4e46b94e82a64efe0fc5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:09.696468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe9bb30b40db4e46b94e82a64efe0fc5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:09.698510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:09.966830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:09.968562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:09.992185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a684e9ee-21c6-4bea-8f63-619a10623dd4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:10.005592 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:10.007150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:10.007804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:10.008298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] PATH_INFO: `/v3/projects/57a64cd6a9284bc080eaac5f8e1c62e6` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:10.010006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57a64cd6a9284bc080eaac5f8e1c62e6)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:10.012814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:10.014228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe9bb30b40db4e46b94e82a64efe0fc5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:10.065665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe9bb30b40db4e46b94e82a64efe0fc5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:10.082793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe9bb30b40db4e46b94e82a64efe0fc5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:10.082793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe9bb30b40db4e46b94e82a64efe0fc5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:10.082793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e92336ba-467e-480c-bac5-17e42164bdce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe9bb30b40db4e46b94e82a64efe0fc5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:10.165415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57a64cd6a9284bc080eaac5f8e1c62e6', 'request_id': 'req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:10.172258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57a64cd6a9284bc080eaac5f8e1c62e6', 'request_id': 'req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:10.222864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 996/2020] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:09 2022] DELETE /identity/v3/users/fe9bb30b40db4e46b94e82a64efe0fc5 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:10.405939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57a64cd6a9284bc080eaac5f8e1c62e6', 'request_id': 'req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:10.426658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] The token cache is being invalidate because project 57a64cd6a9284bc080eaac5f8e1c62e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:10.427176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:10.428193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-466d4f2e-67f4-4a2b-80c9-75ebc15bf5f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:10.430331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1025/2021] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:09 2022] DELETE /identity/v3/projects/57a64cd6a9284bc080eaac5f8e1c62e6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:10.436447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81777626-4f63-4f89-9692-160482f0ab38 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:10.437015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81777626-4f63-4f89-9692-160482f0ab38 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:10.438043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81777626-4f63-4f89-9692-160482f0ab38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:10.465757 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-81777626-4f63-4f89-9692-160482f0ab38 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:10.480117 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-81777626-4f63-4f89-9692-160482f0ab38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:10.549510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 997/2022] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:10.557159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4a9f-be57-48c9-92d0-3f854ccfcabc None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:10.557452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4a9f-be57-48c9-92d0-3f854ccfcabc None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:10.557734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3c4a9f-be57-48c9-92d0-3f854ccfcabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:10.586817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-be3c4a9f-be57-48c9-92d0-3f854ccfcabc None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:10.588841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-be3c4a9f-be57-48c9-92d0-3f854ccfcabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:10.607953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81777626-4f63-4f89-9692-160482f0ab38 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:10.609248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:10.610332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1026/2023] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:10.622417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81777626-4f63-4f89-9692-160482f0ab38 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:10.628025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae324712-168a-47a0-9024-3365eb5ba059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:10.628792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae324712-168a-47a0-9024-3365eb5ba059 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:10.629164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae324712-168a-47a0-9024-3365eb5ba059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:10.629666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae324712-168a-47a0-9024-3365eb5ba059 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:10.630578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae324712-168a-47a0-9024-3365eb5ba059 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:10.631115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae324712-168a-47a0-9024-3365eb5ba059 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:10.633165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae324712-168a-47a0-9024-3365eb5ba059 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:10.649017 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 998/2024] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:11:10.654175 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c4a9f-be57-48c9-92d0-3f854ccfcabc None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:10.665413 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3c4a9f-be57-48c9-92d0-3f854ccfcabc None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:10.671802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95890c56-4f07-4550-aa7b-d7379bf48b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:10.672729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95890c56-4f07-4550-aa7b-d7379bf48b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:10.673353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95890c56-4f07-4550-aa7b-d7379bf48b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:10.673783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95890c56-4f07-4550-aa7b-d7379bf48b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:10.674704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95890c56-4f07-4550-aa7b-d7379bf48b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:10.677839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95890c56-4f07-4550-aa7b-d7379bf48b14 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:10.810323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1027/2025] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:10 2022] POST /identity/v3/projects => generated 373 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:11:10.814951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae324712-168a-47a0-9024-3365eb5ba059 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:10.826344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae324712-168a-47a0-9024-3365eb5ba059 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:10.890150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26be887-8af8-4ac1-b1f4-c441f63121c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:10.890845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26be887-8af8-4ac1-b1f4-c441f63121c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:10.891188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26be887-8af8-4ac1-b1f4-c441f63121c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:10.891467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26be887-8af8-4ac1-b1f4-c441f63121c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:10.892207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26be887-8af8-4ac1-b1f4-c441f63121c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:10.894258 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26be887-8af8-4ac1-b1f4-c441f63121c7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:10.924210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95890c56-4f07-4550-aa7b-d7379bf48b14 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:10.926286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-95890c56-4f07-4550-aa7b-d7379bf48b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:10.956500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95890c56-4f07-4550-aa7b-d7379bf48b14 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:10.956500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:10.956500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:10.956500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:10.956880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] PATH_INFO: `/v3/projects/4f653d83f9d84e73afa30f2d6e4d3fd0` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:10.956880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f653d83f9d84e73afa30f2d6e4d3fd0)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:10.956880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:11.127414 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 999/2026] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:10 2022] POST /identity/v3/users => generated 287 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:11.131576 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26be887-8af8-4ac1-b1f4-c441f63121c7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:11.155039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26be887-8af8-4ac1-b1f4-c441f63121c7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:11.165220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f653d83f9d84e73afa30f2d6e4d3fd0', 'request_id': 'req-65682e07-71aa-4ff0-832d-914f29315478'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.174715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f653d83f9d84e73afa30f2d6e4d3fd0', 'request_id': 'req-65682e07-71aa-4ff0-832d-914f29315478'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.255902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae159ba-d5a1-4be0-aedd-7a7280b60209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:11.256609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae159ba-d5a1-4be0-aedd-7a7280b60209 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:11.256896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae159ba-d5a1-4be0-aedd-7a7280b60209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:11.257172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae159ba-d5a1-4be0-aedd-7a7280b60209 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:11.257909 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae159ba-d5a1-4be0-aedd-7a7280b60209 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:11.259563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae159ba-d5a1-4be0-aedd-7a7280b60209 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:11.262520 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f653d83f9d84e73afa30f2d6e4d3fd0', 'request_id': 'req-65682e07-71aa-4ff0-832d-914f29315478'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.272464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1000/2027] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:11.273581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae159ba-d5a1-4be0-aedd-7a7280b60209 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:11.275562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eae159ba-d5a1-4be0-aedd-7a7280b60209 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:11.275796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] The token cache is being invalidate because project 4f653d83f9d84e73afa30f2d6e4d3fd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:11.276128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.278034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.280585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1028/2028] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:10 2022] DELETE /identity/v3/projects/4f653d83f9d84e73afa30f2d6e4d3fd0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:11.281441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:11.282737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:11.289342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae159ba-d5a1-4be0-aedd-7a7280b60209 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:11.296847 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682e07-71aa-4ff0-832d-914f29315478 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:11.297170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:11.298083 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:11.298384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:11.298651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] PATH_INFO: `/v3/users/c11e369c8ba542f6b089a472e9f42099` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:11.299884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11e369c8ba542f6b089a472e9f42099)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:11.301570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59bb92-2311-4b73-85fd-0cc5dbb740ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:11.301890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:11.302347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59bb92-2311-4b73-85fd-0cc5dbb740ef admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:11.302691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59bb92-2311-4b73-85fd-0cc5dbb740ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:11.303025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a59bb92-2311-4b73-85fd-0cc5dbb740ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:11.303791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59bb92-2311-4b73-85fd-0cc5dbb740ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:11.305383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a59bb92-2311-4b73-85fd-0cc5dbb740ef admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:11.316201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1029/2029] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:11.317302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59bb92-2311-4b73-85fd-0cc5dbb740ef admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:11.321123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3a59bb92-2311-4b73-85fd-0cc5dbb740ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:11.344229 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a59bb92-2311-4b73-85fd-0cc5dbb740ef admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:11.344229 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:11.344229 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:11.344229 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:11.344684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] PATH_INFO: `/v3/users/cf8ca49300844239ac724376a175a34c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:11.344684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf8ca49300844239ac724376a175a34c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:11.344995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:11.645604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11e369c8ba542f6b089a472e9f42099'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.672120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11e369c8ba542f6b089a472e9f42099'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.681537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11e369c8ba542f6b089a472e9f42099'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.682526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11e369c8ba542f6b089a472e9f42099'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.683288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11e369c8ba542f6b089a472e9f42099'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.697747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf8ca49300844239ac724376a175a34c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.814330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1001/2030] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:11 2022] DELETE /identity/v3/users/c11e369c8ba542f6b089a472e9f42099 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:11.815406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:11.817053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:11.898552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a6049d-0b2b-4821-a4ec-b374af58de15 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:11.913102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ce96e-cc8d-4bc4-8146-0f629c2dbae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:11.914546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ce96e-cc8d-4bc4-8146-0f629c2dbae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:11.935235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ce96e-cc8d-4bc4-8146-0f629c2dbae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:11.935235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ce96e-cc8d-4bc4-8146-0f629c2dbae5 admin admin] PATH_INFO: `/v3/projects/942cabe702854b22bf439c6f631130fc/users/1a2bc0cc9df147db86994ab617145c58/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:11.936111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ce96e-cc8d-4bc4-8146-0f629c2dbae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942cabe702854b22bf439c6f631130fc, user_id=1a2bc0cc9df147db86994ab617145c58, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:11.938765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ce96e-cc8d-4bc4-8146-0f629c2dbae5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:11.967421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf8ca49300844239ac724376a175a34c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.975001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf8ca49300844239ac724376a175a34c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.975696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf8ca49300844239ac724376a175a34c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.989167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f989d95f-8ff9-418a-a05f-0dd1a166bc9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf8ca49300844239ac724376a175a34c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:11.995899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1030/2031] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:11 2022] DELETE /identity/v3/users/cf8ca49300844239ac724376a175a34c => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:11.997794 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3443174-e1ff-424b-b7f6-8799811be20b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:11.998116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3443174-e1ff-424b-b7f6-8799811be20b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:11.998566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3443174-e1ff-424b-b7f6-8799811be20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:12.018076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c3443174-e1ff-424b-b7f6-8799811be20b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:12.019321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c3443174-e1ff-424b-b7f6-8799811be20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:12.120828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1031/2032] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:12.131438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3443174-e1ff-424b-b7f6-8799811be20b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:12.135467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c3443174-e1ff-424b-b7f6-8799811be20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:12.159203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1002/2033] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:11 2022] PUT /identity/v3/projects/942cabe702854b22bf439c6f631130fc/users/1a2bc0cc9df147db86994ab617145c58/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:12.160941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc266-8315-4b9c-97ea-a8ad9dc26b84 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:12.161297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc266-8315-4b9c-97ea-a8ad9dc26b84 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:12.161996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedc266-8315-4b9c-97ea-a8ad9dc26b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:12.217839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cfedc266-8315-4b9c-97ea-a8ad9dc26b84 None None] MFA Rules not processed for user `1a2bc0cc9df147db86994ab617145c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:12.219157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cfedc266-8315-4b9c-97ea-a8ad9dc26b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:12.219572 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3443174-e1ff-424b-b7f6-8799811be20b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:12.292752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4699c388-84e0-42bf-acbf-0a0437892ba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:12.293490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c388-84e0-42bf-acbf-0a0437892ba9 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:12.297528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c388-84e0-42bf-acbf-0a0437892ba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:12.297850 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4699c388-84e0-42bf-acbf-0a0437892ba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:12.360214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1003/2034] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:12.366876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc266-8315-4b9c-97ea-a8ad9dc26b84 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:12.369203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cfedc266-8315-4b9c-97ea-a8ad9dc26b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:12.443639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c388-84e0-42bf-acbf-0a0437892ba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:12.445509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4699c388-84e0-42bf-acbf-0a0437892ba9 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:12.457916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1032/2035] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:12.539398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedc266-8315-4b9c-97ea-a8ad9dc26b84 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:12.545385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe1e36-6af8-4e6b-8d71-0556b7b45480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:12.546439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe1e36-6af8-4e6b-8d71-0556b7b45480 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:12.547499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe1e36-6af8-4e6b-8d71-0556b7b45480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:12.547837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe1e36-6af8-4e6b-8d71-0556b7b45480 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:12.548653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe1e36-6af8-4e6b-8d71-0556b7b45480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:12.550711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe1e36-6af8-4e6b-8d71-0556b7b45480 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:12.576144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:12.673040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83890df9-14fd-4ec8-9f70-5f87d9c0cae0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:12.673326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83890df9-14fd-4ec8-9f70-5f87d9c0cae0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:12.673929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83890df9-14fd-4ec8-9f70-5f87d9c0cae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:12.705514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-83890df9-14fd-4ec8-9f70-5f87d9c0cae0 None None] MFA Rules not processed for user `111b06722ed54bcaab771e4788015cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:12.708426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-83890df9-14fd-4ec8-9f70-5f87d9c0cae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:12.742118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1004/2036] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:12 2022] POST /identity/v3/projects => generated 375 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:12.746282 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe1e36-6af8-4e6b-8d71-0556b7b45480 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:12.756419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-50fe1e36-6af8-4e6b-8d71-0556b7b45480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:12.864166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1033/2037] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:12.865769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83890df9-14fd-4ec8-9f70-5f87d9c0cae0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:12.904938 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83890df9-14fd-4ec8-9f70-5f87d9c0cae0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:12.912758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe1e36-6af8-4e6b-8d71-0556b7b45480 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:12.917760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829ec3b-f87c-451b-b4aa-b27df7a81435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:12.921043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:12.921290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ec3b-f87c-451b-b4aa-b27df7a81435 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:12.921616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ec3b-f87c-451b-b4aa-b27df7a81435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:12.921892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ec3b-f87c-451b-b4aa-b27df7a81435 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:12.922727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829ec3b-f87c-451b-b4aa-b27df7a81435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:12.926316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:12.926709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:12.927095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] PATH_INFO: `/v3/projects/11ce1ca4462141f692bc5b96cb1aec07` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:12.928682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=11ce1ca4462141f692bc5b96cb1aec07)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:12.929345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3829ec3b-f87c-451b-b4aa-b27df7a81435 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:12.933611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:13.046738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1034/2038] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:12 2022] POST /identity/v3/users => generated 294 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:13.046738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829ec3b-f87c-451b-b4aa-b27df7a81435 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:13.050439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3829ec3b-f87c-451b-b4aa-b27df7a81435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:13.136704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3829ec3b-f87c-451b-b4aa-b27df7a81435 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:13.141098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11ce1ca4462141f692bc5b96cb1aec07', 'request_id': 'req-6c202205-2339-4cf1-a8d2-3b3c564a95ce'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:13.146693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11ce1ca4462141f692bc5b96cb1aec07', 'request_id': 'req-6c202205-2339-4cf1-a8d2-3b3c564a95ce'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:13.210392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cacba8-b14a-422c-ba2a-27ed761b56b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:13.211389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cacba8-b14a-422c-ba2a-27ed761b56b2 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.211987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cacba8-b14a-422c-ba2a-27ed761b56b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.212563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cacba8-b14a-422c-ba2a-27ed761b56b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.274758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11ce1ca4462141f692bc5b96cb1aec07', 'request_id': 'req-6c202205-2339-4cf1-a8d2-3b3c564a95ce'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:13.285075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cacba8-b14a-422c-ba2a-27ed761b56b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:13.286897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cacba8-b14a-422c-ba2a-27ed761b56b2 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:13.288246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] The token cache is being invalidate because project 11ce1ca4462141f692bc5b96cb1aec07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:13.288542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:13.291233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:13.291233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1005/2039] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:12 2022] DELETE /identity/v3/projects/11ce1ca4462141f692bc5b96cb1aec07 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:13.292198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:13.293801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:13.297593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1035/2040] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:13.298496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cacba8-b14a-422c-ba2a-27ed761b56b2 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:13.299806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-04cacba8-b14a-422c-ba2a-27ed761b56b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:13.371320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c202205-2339-4cf1-a8d2-3b3c564a95ce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:13.377578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd4421-d862-4407-a4d6-831b34a74f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:13.378122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cacba8-b14a-422c-ba2a-27ed761b56b2 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:13.378351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd4421-d862-4407-a4d6-831b34a74f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.378633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd4421-d862-4407-a4d6-831b34a74f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.378940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd4421-d862-4407-a4d6-831b34a74f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.379677 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd4421-d862-4407-a4d6-831b34a74f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:13.381326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd4421-d862-4407-a4d6-831b34a74f7d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:13.383016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:13.383884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.384188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.384464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] PATH_INFO: `/v3/projects/c3e0dc07889b418087ace98dec9cd3b2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.385706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3e0dc07889b418087ace98dec9cd3b2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:13.388248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:13.393179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1006/2041] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:13.394678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c80a77-c848-41e3-ae72-0686e0328552 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.394967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c80a77-c848-41e3-ae72-0686e0328552 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.395246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c80a77-c848-41e3-ae72-0686e0328552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.414580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f9c80a77-c848-41e3-ae72-0686e0328552 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:13.415721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f9c80a77-c848-41e3-ae72-0686e0328552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:13.426233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1007/2042] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:13.426233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c80a77-c848-41e3-ae72-0686e0328552 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:13.436906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c80a77-c848-41e3-ae72-0686e0328552 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:13.441883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480b1b2d-9621-4884-b90d-d753e8dc0a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:13.442887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b1b2d-9621-4884-b90d-d753e8dc0a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.443247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b1b2d-9621-4884-b90d-d753e8dc0a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.443592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480b1b2d-9621-4884-b90d-d753e8dc0a85 admin admin] PATH_INFO: `/v3/projects/cca22e7378044bb7bd969a0e4a35970b/users/52bd8276d0114d5c8187fb9146c1481b/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.462850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b1b2d-9621-4884-b90d-d753e8dc0a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca22e7378044bb7bd969a0e4a35970b, user_id=52bd8276d0114d5c8187fb9146c1481b, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:13.468544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480b1b2d-9621-4884-b90d-d753e8dc0a85 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:13.592177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1008/2043] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:13 2022] PUT /identity/v3/projects/cca22e7378044bb7bd969a0e4a35970b/users/52bd8276d0114d5c8187fb9146c1481b/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:13.593582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06123c6-aec2-47c4-8fef-adfa5999b4a8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.593582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06123c6-aec2-47c4-8fef-adfa5999b4a8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.593842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06123c6-aec2-47c4-8fef-adfa5999b4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.605863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3e0dc07889b418087ace98dec9cd3b2', 'request_id': 'req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:13.613600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3e0dc07889b418087ace98dec9cd3b2', 'request_id': 'req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:13.613778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d06123c6-aec2-47c4-8fef-adfa5999b4a8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:13.615426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d06123c6-aec2-47c4-8fef-adfa5999b4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:13.680991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1009/2044] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:13.685657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06123c6-aec2-47c4-8fef-adfa5999b4a8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:13.695240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06123c6-aec2-47c4-8fef-adfa5999b4a8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:13.700644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde699c-d0ad-477e-8413-355d861e9f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:13.701438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde699c-d0ad-477e-8413-355d861e9f86 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.701719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde699c-d0ad-477e-8413-355d861e9f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.701996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde699c-d0ad-477e-8413-355d861e9f86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.702728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde699c-d0ad-477e-8413-355d861e9f86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:13.704374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde699c-d0ad-477e-8413-355d861e9f86 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:13.714740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1010/2045] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:13.715572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde699c-d0ad-477e-8413-355d861e9f86 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:13.726166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde699c-d0ad-477e-8413-355d861e9f86 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:13.733598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b40ac4-6220-4ab3-875b-8de0466cb66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:13.734243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b40ac4-6220-4ab3-875b-8de0466cb66d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.734523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b40ac4-6220-4ab3-875b-8de0466cb66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.734808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b40ac4-6220-4ab3-875b-8de0466cb66d admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.735552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b40ac4-6220-4ab3-875b-8de0466cb66d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:13.735908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b40ac4-6220-4ab3-875b-8de0466cb66d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:13.738132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b40ac4-6220-4ab3-875b-8de0466cb66d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:13.753045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1011/2046] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:13.754123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b40ac4-6220-4ab3-875b-8de0466cb66d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:13.765727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b40ac4-6220-4ab3-875b-8de0466cb66d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:13.770821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3e0dc07889b418087ace98dec9cd3b2', 'request_id': 'req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:13.781488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312a37-637f-4b7f-a6a8-b25910df5b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:13.782517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312a37-637f-4b7f-a6a8-b25910df5b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.783247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312a37-637f-4b7f-a6a8-b25910df5b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.783533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b312a37-637f-4b7f-a6a8-b25910df5b48 admin admin] PATH_INFO: `/v3/projects/cca22e7378044bb7bd969a0e4a35970b/users/52bd8276d0114d5c8187fb9146c1481b/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.785443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] The token cache is being invalidate because project c3e0dc07889b418087ace98dec9cd3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:13.785805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:13.786778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:13.788405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312a37-637f-4b7f-a6a8-b25910df5b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cca22e7378044bb7bd969a0e4a35970b, user_id=52bd8276d0114d5c8187fb9146c1481b, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:13.791707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1036/2047] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:13 2022] DELETE /identity/v3/projects/c3e0dc07889b418087ace98dec9cd3b2 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:13.791707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:13.791707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:13.792061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b312a37-637f-4b7f-a6a8-b25910df5b48 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:13.808950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1012/2048] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:13 2022] PUT /identity/v3/projects/cca22e7378044bb7bd969a0e4a35970b/users/52bd8276d0114d5c8187fb9146c1481b/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:13.811016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312a37-637f-4b7f-a6a8-b25910df5b48 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:13.813284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7b312a37-637f-4b7f-a6a8-b25910df5b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:13.842589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc18fd9a-a44b-4f43-b99a-5c720fe693e7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:13.897022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b312a37-637f-4b7f-a6a8-b25910df5b48 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:13.912447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:13.913534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.913818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.914272 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] PATH_INFO: `/v3/users/34a7b66d3e57402294a19b8b1ba8cef2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.915728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34a7b66d3e57402294a19b8b1ba8cef2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:13.920110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:13.929120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb730f-13da-429d-b56e-a714f2b9e0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:13.929801 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb730f-13da-429d-b56e-a714f2b9e0e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:13.930080 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb730f-13da-429d-b56e-a714f2b9e0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:13.930358 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb730f-13da-429d-b56e-a714f2b9e0e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:13.931078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb730f-13da-429d-b56e-a714f2b9e0e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:13.936094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb730f-13da-429d-b56e-a714f2b9e0e2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:14.177029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1037/2049] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:13 2022] POST /identity/v3/projects => generated 389 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:14.178824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9934f-3ea1-4cb8-b43f-451bf476ee50 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:14.179326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9934f-3ea1-4cb8-b43f-451bf476ee50 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:14.179731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9934f-3ea1-4cb8-b43f-451bf476ee50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:14.212084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34a7b66d3e57402294a19b8b1ba8cef2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:14.224902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fec9934f-3ea1-4cb8-b43f-451bf476ee50 None None] MFA Rules not processed for user `52bd8276d0114d5c8187fb9146c1481b`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:14.226944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34a7b66d3e57402294a19b8b1ba8cef2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:14.228151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fec9934f-3ea1-4cb8-b43f-451bf476ee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:14.236411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34a7b66d3e57402294a19b8b1ba8cef2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:14.237299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34a7b66d3e57402294a19b8b1ba8cef2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:14.237923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34a7b66d3e57402294a19b8b1ba8cef2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:14.357200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1013/2050] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:13 2022] DELETE /identity/v3/users/34a7b66d3e57402294a19b8b1ba8cef2 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:14.357200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:14.357200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:14.357880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1038/2051] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:14.368264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9934f-3ea1-4cb8-b43f-451bf476ee50 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:14.373434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fec9934f-3ea1-4cb8-b43f-451bf476ee50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:14.456927 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9934f-3ea1-4cb8-b43f-451bf476ee50 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:14.492349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160e327a-c07e-45b1-a8cd-8cd0c74df5d1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:14.498530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77938fe-b274-493d-91f7-0cef61360ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:14.499477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77938fe-b274-493d-91f7-0cef61360ae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:14.499757 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77938fe-b274-493d-91f7-0cef61360ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:14.500068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77938fe-b274-493d-91f7-0cef61360ae1 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:14.504153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77938fe-b274-493d-91f7-0cef61360ae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:14.504153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77938fe-b274-493d-91f7-0cef61360ae1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:14.527593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea7ed3-4811-4dc2-a3ff-94ab60b12f11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:14.528550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea7ed3-4811-4dc2-a3ff-94ab60b12f11 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:14.529058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea7ed3-4811-4dc2-a3ff-94ab60b12f11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:14.529644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea7ed3-4811-4dc2-a3ff-94ab60b12f11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:14.531524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ceea7ed3-4811-4dc2-a3ff-94ab60b12f11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:14.597742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea7ed3-4811-4dc2-a3ff-94ab60b12f11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:14.599356 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceea7ed3-4811-4dc2-a3ff-94ab60b12f11 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:14.619193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1039/2052] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:14.623810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1014/2053] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:14 2022] POST /identity/v3/users => generated 295 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:14.629472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea7ed3-4811-4dc2-a3ff-94ab60b12f11 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:14.642615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceea7ed3-4811-4dc2-a3ff-94ab60b12f11 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:14.652621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc85ef-ef56-4386-b1dd-8b5da5a7a094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:14.654058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc85ef-ef56-4386-b1dd-8b5da5a7a094 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:14.654474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc85ef-ef56-4386-b1dd-8b5da5a7a094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:14.654926 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc85ef-ef56-4386-b1dd-8b5da5a7a094 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:14.656332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc85ef-ef56-4386-b1dd-8b5da5a7a094 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:14.659372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc85ef-ef56-4386-b1dd-8b5da5a7a094 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:14.677000 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1040/2054] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:14.698495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77938fe-b274-493d-91f7-0cef61360ae1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:14.713693 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77938fe-b274-493d-91f7-0cef61360ae1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:14.720290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:14.720451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d0afe-a240-451c-b94b-559bed5d4a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:14.721035 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0afe-a240-451c-b94b-559bed5d4a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:14.721316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0afe-a240-451c-b94b-559bed5d4a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:14.721630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d0afe-a240-451c-b94b-559bed5d4a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:14.722393 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d0afe-a240-451c-b94b-559bed5d4a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:14.724262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d0afe-a240-451c-b94b-559bed5d4a9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:14.742706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1015/2055] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:14.743268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc85ef-ef56-4386-b1dd-8b5da5a7a094 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:14.755145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc85ef-ef56-4386-b1dd-8b5da5a7a094 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:14.760660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb649d-c4a6-486a-b235-13a09d7aaa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:14.761723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb649d-c4a6-486a-b235-13a09d7aaa9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:14.762318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb649d-c4a6-486a-b235-13a09d7aaa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:14.763123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb649d-c4a6-486a-b235-13a09d7aaa9e admin admin] PATH_INFO: `/v3/projects/bdbd1dc51d6f46e6bd6a380f3b3d3bb5/users/8abe881da6f24809bff505189074fac3/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:14.784741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb649d-c4a6-486a-b235-13a09d7aaa9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbd1dc51d6f46e6bd6a380f3b3d3bb5, user_id=8abe881da6f24809bff505189074fac3, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:14.789322 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb649d-c4a6-486a-b235-13a09d7aaa9e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:14.978488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1041/2056] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:14 2022] PUT /identity/v3/projects/bdbd1dc51d6f46e6bd6a380f3b3d3bb5/users/8abe881da6f24809bff505189074fac3/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:14.990579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f603b2d-559e-4703-b6a2-91cafad5e0a3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:14.990875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f603b2d-559e-4703-b6a2-91cafad5e0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:14.991179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f603b2d-559e-4703-b6a2-91cafad5e0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:15.019574 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1f603b2d-559e-4703-b6a2-91cafad5e0a3 None None] MFA Rules not processed for user `8abe881da6f24809bff505189074fac3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:15.020877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1f603b2d-559e-4703-b6a2-91cafad5e0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:15.047214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb649d-c4a6-486a-b235-13a09d7aaa9e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:15.053921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-57bb649d-c4a6-486a-b235-13a09d7aaa9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:15.122254 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1016/2057] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:15.126984 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f603b2d-559e-4703-b6a2-91cafad5e0a3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:15.149448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb649d-c4a6-486a-b235-13a09d7aaa9e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:15.155040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:15.155904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:15.156212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:15.156499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] PATH_INFO: `/v3/projects/18e458bc2abc42c8b6af6bb29e557860` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:15.157734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18e458bc2abc42c8b6af6bb29e557860)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:15.159684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:15.198912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f603b2d-559e-4703-b6a2-91cafad5e0a3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:15.204295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517cb4d-cdb7-4ba0-911d-04cc99eb7981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:15.205057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517cb4d-cdb7-4ba0-911d-04cc99eb7981 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:15.205445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517cb4d-cdb7-4ba0-911d-04cc99eb7981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:15.205838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517cb4d-cdb7-4ba0-911d-04cc99eb7981 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:15.206703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517cb4d-cdb7-4ba0-911d-04cc99eb7981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:15.209045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517cb4d-cdb7-4ba0-911d-04cc99eb7981 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:15.388998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18e458bc2abc42c8b6af6bb29e557860', 'request_id': 'req-34ae9b61-5b95-48e2-befc-6cb115994804'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:15.415940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18e458bc2abc42c8b6af6bb29e557860', 'request_id': 'req-34ae9b61-5b95-48e2-befc-6cb115994804'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:15.448376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1017/2058] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:15 2022] POST /identity/v3/projects => generated 389 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:11:15.457149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517cb4d-cdb7-4ba0-911d-04cc99eb7981 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:15.556079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517cb4d-cdb7-4ba0-911d-04cc99eb7981 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:15.563073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f273df-febb-4c2c-8021-8c2cf41fe390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:15.563856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f273df-febb-4c2c-8021-8c2cf41fe390 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:15.564285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f273df-febb-4c2c-8021-8c2cf41fe390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:15.565151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f273df-febb-4c2c-8021-8c2cf41fe390 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:15.565540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f273df-febb-4c2c-8021-8c2cf41fe390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:15.567601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f273df-febb-4c2c-8021-8c2cf41fe390 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:15.595873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18e458bc2abc42c8b6af6bb29e557860', 'request_id': 'req-34ae9b61-5b95-48e2-befc-6cb115994804'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:15.614196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] The token cache is being invalidate because project 18e458bc2abc42c8b6af6bb29e557860 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:15.614634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:15.615536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:15.620688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1042/2059] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:15 2022] DELETE /identity/v3/projects/18e458bc2abc42c8b6af6bb29e557860 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:15.620688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:15.620688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:15.698315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1018/2060] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:15 2022] POST /identity/v3/users => generated 301 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:15.698607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45f496-172a-41c3-8bad-5af15fc5877f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:15.698884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45f496-172a-41c3-8bad-5af15fc5877f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:15.700993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45f496-172a-41c3-8bad-5af15fc5877f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:15.732543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:15.743664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ae9b61-5b95-48e2-befc-6cb115994804 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:15.747021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bf45f496-172a-41c3-8bad-5af15fc5877f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:15.747558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bf45f496-172a-41c3-8bad-5af15fc5877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:15.750814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:15.751822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:15.752227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:15.752610 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] PATH_INFO: `/v3/users/1b16ee911cf3485bb96415a789b4976d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:15.753954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b16ee911cf3485bb96415a789b4976d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:15.756268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:15.774975 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1019/2061] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:15.776015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45f496-172a-41c3-8bad-5af15fc5877f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:15.781042 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bf45f496-172a-41c3-8bad-5af15fc5877f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:15.794850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45f496-172a-41c3-8bad-5af15fc5877f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:15.801045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38783f1-a44e-4090-b959-10e5d77db6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:15.802025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38783f1-a44e-4090-b959-10e5d77db6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:15.802025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38783f1-a44e-4090-b959-10e5d77db6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:15.802293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38783f1-a44e-4090-b959-10e5d77db6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:15.802987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38783f1-a44e-4090-b959-10e5d77db6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:15.813297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38783f1-a44e-4090-b959-10e5d77db6f6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:15.838666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1020/2062] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:15.840637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8716a-dbee-4528-8ccc-cac19e5a8d83 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:15.840931 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8716a-dbee-4528-8ccc-cac19e5a8d83 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:15.841256 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8716a-dbee-4528-8ccc-cac19e5a8d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:15.860840 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1db8716a-dbee-4528-8ccc-cac19e5a8d83 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:15.862224 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1db8716a-dbee-4528-8ccc-cac19e5a8d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:15.885241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1021/2063] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:15.886014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8716a-dbee-4528-8ccc-cac19e5a8d83 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:15.898179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8716a-dbee-4528-8ccc-cac19e5a8d83 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:15.908006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a395ea-4fd0-4444-9171-ca10f51a5fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:15.908006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a395ea-4fd0-4444-9171-ca10f51a5fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:15.908006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a395ea-4fd0-4444-9171-ca10f51a5fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:15.908006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a395ea-4fd0-4444-9171-ca10f51a5fcd admin admin] PATH_INFO: `/v3/projects/20e646aef43246fba6a0e1bfb31888dd/users/6ec49413e9c041d7b68be1d7fbc466f5/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:15.925334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a395ea-4fd0-4444-9171-ca10f51a5fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e646aef43246fba6a0e1bfb31888dd, user_id=6ec49413e9c041d7b68be1d7fbc466f5, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:15.927563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a395ea-4fd0-4444-9171-ca10f51a5fcd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:16.066586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1022/2064] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:15 2022] PUT /identity/v3/projects/20e646aef43246fba6a0e1bfb31888dd/users/6ec49413e9c041d7b68be1d7fbc466f5/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:16.068287 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a395ea-4fd0-4444-9171-ca10f51a5fcd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:16.100524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b16ee911cf3485bb96415a789b4976d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:16.202402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b16ee911cf3485bb96415a789b4976d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:16.216910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b16ee911cf3485bb96415a789b4976d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:16.216910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b16ee911cf3485bb96415a789b4976d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:16.217220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a395ea-4fd0-4444-9171-ca10f51a5fcd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:16.221729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75899ce9-ed83-4d2c-b9ce-6e48ec017830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:16.222826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75899ce9-ed83-4d2c-b9ce-6e48ec017830 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:16.231645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b16ee911cf3485bb96415a789b4976d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:16.233146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75899ce9-ed83-4d2c-b9ce-6e48ec017830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:16.233416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75899ce9-ed83-4d2c-b9ce-6e48ec017830 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:16.234349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75899ce9-ed83-4d2c-b9ce-6e48ec017830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:16.234790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75899ce9-ed83-4d2c-b9ce-6e48ec017830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:16.236525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75899ce9-ed83-4d2c-b9ce-6e48ec017830 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:16.246534 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1043/2065] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:15 2022] DELETE /identity/v3/users/1b16ee911cf3485bb96415a789b4976d => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:16.246534 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:16.246534 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:16.258014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1023/2066] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:16.259596 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28cc0-04c1-4225-a345-b53004ff070d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:16.260540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28cc0-04c1-4225-a345-b53004ff070d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:16.260540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c28cc0-04c1-4225-a345-b53004ff070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:16.285217 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-69c28cc0-04c1-4225-a345-b53004ff070d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:16.292560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-69c28cc0-04c1-4225-a345-b53004ff070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:16.424690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5490a-38ec-44b3-bca6-a893ff97e39f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:16.424690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71830f8b-4d9e-4cf5-a1a0-354135c72493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:16.424690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71830f8b-4d9e-4cf5-a1a0-354135c72493 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:16.424690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71830f8b-4d9e-4cf5-a1a0-354135c72493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:16.426435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71830f8b-4d9e-4cf5-a1a0-354135c72493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:16.426435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71830f8b-4d9e-4cf5-a1a0-354135c72493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:16.426435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71830f8b-4d9e-4cf5-a1a0-354135c72493 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:16.426435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1044/2067] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:16.426435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71830f8b-4d9e-4cf5-a1a0-354135c72493 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:16.426435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-71830f8b-4d9e-4cf5-a1a0-354135c72493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:16.426862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1024/2068] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:16.426957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71830f8b-4d9e-4cf5-a1a0-354135c72493 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:16.426957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a5049-6162-4d49-b741-edd80423e20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:16.426957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5049-6162-4d49-b741-edd80423e20f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:16.426957 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5049-6162-4d49-b741-edd80423e20f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:16.427259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a5049-6162-4d49-b741-edd80423e20f admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:16.427259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a5049-6162-4d49-b741-edd80423e20f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:16.427259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a5049-6162-4d49-b741-edd80423e20f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:16.427493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c28cc0-04c1-4225-a345-b53004ff070d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:16.432903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c28cc0-04c1-4225-a345-b53004ff070d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:16.438687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd7586-10e5-49bf-9a85-715c7175d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:16.439671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd7586-10e5-49bf-9a85-715c7175d5e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:16.440056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd7586-10e5-49bf-9a85-715c7175d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:16.440402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd7586-10e5-49bf-9a85-715c7175d5e5 admin admin] PATH_INFO: `/v3/projects/20e646aef43246fba6a0e1bfb31888dd/users/6ec49413e9c041d7b68be1d7fbc466f5/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:16.442429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd7586-10e5-49bf-9a85-715c7175d5e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e646aef43246fba6a0e1bfb31888dd, user_id=6ec49413e9c041d7b68be1d7fbc466f5, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:16.445268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd7586-10e5-49bf-9a85-715c7175d5e5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:16.463353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1025/2069] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:16 2022] PUT /identity/v3/projects/20e646aef43246fba6a0e1bfb31888dd/users/6ec49413e9c041d7b68be1d7fbc466f5/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:16.464244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd7586-10e5-49bf-9a85-715c7175d5e5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:16.555899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-73cd7586-10e5-49bf-9a85-715c7175d5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:16.555899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd7586-10e5-49bf-9a85-715c7175d5e5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:16.555899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ebcda2-48c2-488d-95e2-2dd30eb6a6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:16.557418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebcda2-48c2-488d-95e2-2dd30eb6a6ea service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:16.557418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebcda2-48c2-488d-95e2-2dd30eb6a6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:16.557418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ebcda2-48c2-488d-95e2-2dd30eb6a6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:16.626051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebcda2-48c2-488d-95e2-2dd30eb6a6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:16.627687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ebcda2-48c2-488d-95e2-2dd30eb6a6ea service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:16.639411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1026/2070] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:16.641856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b25835-5f57-42c9-9ef5-019df01de383 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:16.642153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b25835-5f57-42c9-9ef5-019df01de383 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:16.642429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b25835-5f57-42c9-9ef5-019df01de383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:16.697066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b8b25835-5f57-42c9-9ef5-019df01de383 None None] MFA Rules not processed for user `6ec49413e9c041d7b68be1d7fbc466f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:16.703681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b8b25835-5f57-42c9-9ef5-019df01de383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:16.788683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1027/2071] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:16 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:16.800727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b25835-5f57-42c9-9ef5-019df01de383 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:16.802144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b8b25835-5f57-42c9-9ef5-019df01de383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:16.861670 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b25835-5f57-42c9-9ef5-019df01de383 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:16.865700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485683a-01d9-4c11-8839-bf947c4fb19a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:16.866360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485683a-01d9-4c11-8839-bf947c4fb19a service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:16.866643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485683a-01d9-4c11-8839-bf947c4fb19a service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:16.867131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485683a-01d9-4c11-8839-bf947c4fb19a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:16.874004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1045/2072] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:16 2022] POST /identity/v3/projects => generated 387 bytes in 500 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:16.877172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:16.878580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a5049-6162-4d49-b741-edd80423e20f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:16.878876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485683a-01d9-4c11-8839-bf947c4fb19a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:16.880394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485683a-01d9-4c11-8839-bf947c4fb19a service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:16.900098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1028/2073] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:17.028363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a5049-6162-4d49-b741-edd80423e20f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:17.046035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a805b47-1363-409e-a08d-4a9205b9f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:17.046035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a805b47-1363-409e-a08d-4a9205b9f6ba admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:17.046035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a805b47-1363-409e-a08d-4a9205b9f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:17.046035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a805b47-1363-409e-a08d-4a9205b9f6ba admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:17.046480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a805b47-1363-409e-a08d-4a9205b9f6ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:17.050798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a805b47-1363-409e-a08d-4a9205b9f6ba admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:17.127118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485683a-01d9-4c11-8839-bf947c4fb19a service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:17.138493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485683a-01d9-4c11-8839-bf947c4fb19a service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:17.144112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:17.150381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:17.150381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:17.150381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] PATH_INFO: `/v3/users/8abe881da6f24809bff505189074fac3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:17.150381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8abe881da6f24809bff505189074fac3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:17.150381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:17.239438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1046/2074] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:16 2022] POST /identity/v3/users => generated 294 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:17.243556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a805b47-1363-409e-a08d-4a9205b9f6ba admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:17.257032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a805b47-1363-409e-a08d-4a9205b9f6ba admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:17.261975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2a206-9bd9-47f3-9b5e-890b5d38b71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:17.262852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2a206-9bd9-47f3-9b5e-890b5d38b71b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:17.263453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2a206-9bd9-47f3-9b5e-890b5d38b71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:17.263741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e2a206-9bd9-47f3-9b5e-890b5d38b71b admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:17.264690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2a206-9bd9-47f3-9b5e-890b5d38b71b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:17.266334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e2a206-9bd9-47f3-9b5e-890b5d38b71b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:17.279867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1047/2075] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:11:17.283898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2a206-9bd9-47f3-9b5e-890b5d38b71b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:17.295591 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e2a206-9bd9-47f3-9b5e-890b5d38b71b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:17.300667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722e227-0054-4239-921e-ac48a3a74bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:17.301165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722e227-0054-4239-921e-ac48a3a74bce admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:17.301451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722e227-0054-4239-921e-ac48a3a74bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:17.301731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722e227-0054-4239-921e-ac48a3a74bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:17.302480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722e227-0054-4239-921e-ac48a3a74bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:17.304134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722e227-0054-4239-921e-ac48a3a74bce admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:17.324436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1048/2076] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:17.328455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722e227-0054-4239-921e-ac48a3a74bce admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:17.341167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722e227-0054-4239-921e-ac48a3a74bce admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:17.351690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b093e-86bc-4125-ba12-a6f7ac6926eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:17.351690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b093e-86bc-4125-ba12-a6f7ac6926eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:17.351690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b093e-86bc-4125-ba12-a6f7ac6926eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:17.351690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b093e-86bc-4125-ba12-a6f7ac6926eb admin admin] PATH_INFO: `/v3/projects/9fa4153852e6432fb30c63473d47a784/users/d45c2dd0d36940fa90996fc93b2bd0ee/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:17.364441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b093e-86bc-4125-ba12-a6f7ac6926eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa4153852e6432fb30c63473d47a784, user_id=d45c2dd0d36940fa90996fc93b2bd0ee, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:17.367380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5b093e-86bc-4125-ba12-a6f7ac6926eb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:17.451720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8abe881da6f24809bff505189074fac3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:17.463802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8abe881da6f24809bff505189074fac3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:17.470865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8abe881da6f24809bff505189074fac3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:17.471555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8abe881da6f24809bff505189074fac3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:17.472194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-89fb102b-2987-4776-b194-92b0a8582477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8abe881da6f24809bff505189074fac3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:17.532669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1049/2077] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:17 2022] PUT /identity/v3/projects/9fa4153852e6432fb30c63473d47a784/users/d45c2dd0d36940fa90996fc93b2bd0ee/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:17.533846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b093e-86bc-4125-ba12-a6f7ac6926eb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:17.535655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-be5b093e-86bc-4125-ba12-a6f7ac6926eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:17.593468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1029/2078] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:17 2022] DELETE /identity/v3/users/8abe881da6f24809bff505189074fac3 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:17.600135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3661e8-589a-45c6-9afd-37645732f4a6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:17.600436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3661e8-589a-45c6-9afd-37645732f4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:17.600725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3661e8-589a-45c6-9afd-37645732f4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:17.605387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5b093e-86bc-4125-ba12-a6f7ac6926eb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:17.628009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8e3661e8-589a-45c6-9afd-37645732f4a6 None None] MFA Rules not processed for user `d45c2dd0d36940fa90996fc93b2bd0ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:17.629238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8e3661e8-589a-45c6-9afd-37645732f4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:17.663667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:17.664635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:17.665034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:17.665320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] PATH_INFO: `/v3/projects/c8cd1cac3d354220965b74d9e0953fe1` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:17.666508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8cd1cac3d354220965b74d9e0953fe1)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:17.670512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:17.703943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1030/2079] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:17.705397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86f10-dc15-43c9-845f-57c8155d48fd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:17.705721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86f10-dc15-43c9-845f-57c8155d48fd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:17.705965 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda86f10-dc15-43c9-845f-57c8155d48fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:17.724741 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bda86f10-dc15-43c9-845f-57c8155d48fd None None] MFA Rules not processed for user `111b06722ed54bcaab771e4788015cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:17.726988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bda86f10-dc15-43c9-845f-57c8155d48fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:17.787760 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1031/2080] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:17.789275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd0192-f7f6-48c9-8a4a-bb01de8c21f4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:17.789619 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd0192-f7f6-48c9-8a4a-bb01de8c21f4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:17.789898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd0192-f7f6-48c9-8a4a-bb01de8c21f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:17.808432 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-69dd0192-f7f6-48c9-8a4a-bb01de8c21f4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:17.810401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-69dd0192-f7f6-48c9-8a4a-bb01de8c21f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:17.825170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8cd1cac3d354220965b74d9e0953fe1', 'request_id': 'req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:17.833468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8cd1cac3d354220965b74d9e0953fe1', 'request_id': 'req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:17.894526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1032/2081] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:17.895715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd0192-f7f6-48c9-8a4a-bb01de8c21f4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:17.898763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-69dd0192-f7f6-48c9-8a4a-bb01de8c21f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:17.916439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd0192-f7f6-48c9-8a4a-bb01de8c21f4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:17.916439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0257c8c-31a1-43ac-a4c1-9e06a6a63479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:17.916948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257c8c-31a1-43ac-a4c1-9e06a6a63479 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:17.917231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257c8c-31a1-43ac-a4c1-9e06a6a63479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:17.917583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0257c8c-31a1-43ac-a4c1-9e06a6a63479 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:17.918202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0257c8c-31a1-43ac-a4c1-9e06a6a63479 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:17.920836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0257c8c-31a1-43ac-a4c1-9e06a6a63479 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:17.938204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8cd1cac3d354220965b74d9e0953fe1', 'request_id': 'req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:17.956145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] The token cache is being invalidate because project c8cd1cac3d354220965b74d9e0953fe1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:17.956552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:17.957313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:17.963955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1050/2082] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:17 2022] DELETE /identity/v3/projects/c8cd1cac3d354220965b74d9e0953fe1 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:17.964386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:17.966516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:18.034415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e4a6f-58a9-406c-9b9a-c2fdf1612d5c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.038963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed4fc7-e345-4991-85b7-efcb9cce2853 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.039619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4fc7-e345-4991-85b7-efcb9cce2853 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.040183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4fc7-e345-4991-85b7-efcb9cce2853 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.040183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed4fc7-e345-4991-85b7-efcb9cce2853 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.041977 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-99ed4fc7-e345-4991-85b7-efcb9cce2853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:18.055537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1033/2083] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:17 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:18.057015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d388e-083e-48b6-8f72-e09862cc2293 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.057401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d388e-083e-48b6-8f72-e09862cc2293 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.057807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d388e-083e-48b6-8f72-e09862cc2293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.062460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed4fc7-e345-4991-85b7-efcb9cce2853 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.064121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed4fc7-e345-4991-85b7-efcb9cce2853 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.078849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1051/2084] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:18.081678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-af8d388e-083e-48b6-8f72-e09862cc2293 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:18.088167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed4fc7-e345-4991-85b7-efcb9cce2853 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.088431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-af8d388e-083e-48b6-8f72-e09862cc2293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:18.088534 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-99ed4fc7-e345-4991-85b7-efcb9cce2853 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:18.114568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed4fc7-e345-4991-85b7-efcb9cce2853 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.174331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1034/2085] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:18.177064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118a7ca-a4c6-4bfb-9fa4-3635d6766574 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.177636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118a7ca-a4c6-4bfb-9fa4-3635d6766574 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.178443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118a7ca-a4c6-4bfb-9fa4-3635d6766574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.219818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b118a7ca-a4c6-4bfb-9fa4-3635d6766574 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:18.221317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b118a7ca-a4c6-4bfb-9fa4-3635d6766574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:18.223511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8219c9-6c59-4f67-90b8-03999def682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.243265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8219c9-6c59-4f67-90b8-03999def682a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.243265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8219c9-6c59-4f67-90b8-03999def682a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.243265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8219c9-6c59-4f67-90b8-03999def682a admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.243265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8219c9-6c59-4f67-90b8-03999def682a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.243265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8219c9-6c59-4f67-90b8-03999def682a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.248856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1035/2086] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:18.251450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118a7ca-a4c6-4bfb-9fa4-3635d6766574 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.263559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118a7ca-a4c6-4bfb-9fa4-3635d6766574 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.275073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88718349-aeee-4558-a8b1-acebd47a5bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.275073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88718349-aeee-4558-a8b1-acebd47a5bc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.275073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88718349-aeee-4558-a8b1-acebd47a5bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.275073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88718349-aeee-4558-a8b1-acebd47a5bc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.275417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88718349-aeee-4558-a8b1-acebd47a5bc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:18.275417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88718349-aeee-4558-a8b1-acebd47a5bc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.275417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88718349-aeee-4558-a8b1-acebd47a5bc0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.290614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1036/2087] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:18.291570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88718349-aeee-4558-a8b1-acebd47a5bc0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.301867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88718349-aeee-4558-a8b1-acebd47a5bc0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.308231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3de4d-7ab6-4d87-a19c-3bcb9df2c434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.309023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3de4d-7ab6-4d87-a19c-3bcb9df2c434 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.310407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3de4d-7ab6-4d87-a19c-3bcb9df2c434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.310682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3de4d-7ab6-4d87-a19c-3bcb9df2c434 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.311412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3de4d-7ab6-4d87-a19c-3bcb9df2c434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.313367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3de4d-7ab6-4d87-a19c-3bcb9df2c434 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.397261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1052/2088] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:18 2022] POST /identity/v3/users => generated 300 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:18.401285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8219c9-6c59-4f67-90b8-03999def682a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.412587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8219c9-6c59-4f67-90b8-03999def682a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.419306 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c20c8-8002-4cd7-8511-763d336ae590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.420501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c20c8-8002-4cd7-8511-763d336ae590 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.420972 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c20c8-8002-4cd7-8511-763d336ae590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.423255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c20c8-8002-4cd7-8511-763d336ae590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.423255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c20c8-8002-4cd7-8511-763d336ae590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.424384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c20c8-8002-4cd7-8511-763d336ae590 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.433550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1037/2089] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:18 2022] POST /identity/v3/projects => generated 373 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:18.440815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1053/2090] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:18.442522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3de4d-7ab6-4d87-a19c-3bcb9df2c434 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.444685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c20c8-8002-4cd7-8511-763d336ae590 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.460788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c20c8-8002-4cd7-8511-763d336ae590 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.535121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3de4d-7ab6-4d87-a19c-3bcb9df2c434 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.561131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662e2e2-bddd-4b1a-a553-6f2d28164801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.562116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662e2e2-bddd-4b1a-a553-6f2d28164801 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.562407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662e2e2-bddd-4b1a-a553-6f2d28164801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.562738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662e2e2-bddd-4b1a-a553-6f2d28164801 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.563307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58554e44-6696-4fb7-ae1f-f53e2ac5b494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.563804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662e2e2-bddd-4b1a-a553-6f2d28164801 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.564244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58554e44-6696-4fb7-ae1f-f53e2ac5b494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.565498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662e2e2-bddd-4b1a-a553-6f2d28164801 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.565802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58554e44-6696-4fb7-ae1f-f53e2ac5b494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.566087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58554e44-6696-4fb7-ae1f-f53e2ac5b494 admin admin] PATH_INFO: `/v3/projects/823981b45c5b42489fe16c8bc55d0576/users/39129c0d25654f11b0cb3adf6228a7ac/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.586289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58554e44-6696-4fb7-ae1f-f53e2ac5b494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823981b45c5b42489fe16c8bc55d0576, user_id=39129c0d25654f11b0cb3adf6228a7ac, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.589110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58554e44-6696-4fb7-ae1f-f53e2ac5b494 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.702938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1038/2091] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:18 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:18.707844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662e2e2-bddd-4b1a-a553-6f2d28164801 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.721261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662e2e2-bddd-4b1a-a553-6f2d28164801 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.731513 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1054/2092] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:18 2022] PUT /identity/v3/projects/823981b45c5b42489fe16c8bc55d0576/users/39129c0d25654f11b0cb3adf6228a7ac/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:18.731513 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58554e44-6696-4fb7-ae1f-f53e2ac5b494 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.736765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-58554e44-6696-4fb7-ae1f-f53e2ac5b494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:18.818070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02897ba4-29bd-4add-9ec5-d12f1b535d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.819195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02897ba4-29bd-4add-9ec5-d12f1b535d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.819195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02897ba4-29bd-4add-9ec5-d12f1b535d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.819374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02897ba4-29bd-4add-9ec5-d12f1b535d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.820083 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02897ba4-29bd-4add-9ec5-d12f1b535d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.821738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02897ba4-29bd-4add-9ec5-d12f1b535d16 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.824676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58554e44-6696-4fb7-ae1f-f53e2ac5b494 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.832350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.832994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1039/2093] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:18.833300 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.833550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.833993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02897ba4-29bd-4add-9ec5-d12f1b535d16 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.834141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] PATH_INFO: `/v3/projects/bdbd1dc51d6f46e6bd6a380f3b3d3bb5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.835076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdbd1dc51d6f46e6bd6a380f3b3d3bb5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.838298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.846416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02897ba4-29bd-4add-9ec5-d12f1b535d16 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.851825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cca23-8aa5-4ff8-9e19-8358df727121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.855044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cca23-8aa5-4ff8-9e19-8358df727121 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.855044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cca23-8aa5-4ff8-9e19-8358df727121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.855044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cca23-8aa5-4ff8-9e19-8358df727121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.855044 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cca23-8aa5-4ff8-9e19-8358df727121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.855857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8cca23-8aa5-4ff8-9e19-8358df727121 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.872581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1040/2094] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:18.872581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cca23-8aa5-4ff8-9e19-8358df727121 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.880571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8cca23-8aa5-4ff8-9e19-8358df727121 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.885279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac167e0e-565b-4471-957c-cc4bbf86fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.885940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac167e0e-565b-4471-957c-cc4bbf86fd0d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.886226 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac167e0e-565b-4471-957c-cc4bbf86fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.886504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac167e0e-565b-4471-957c-cc4bbf86fd0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.887295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac167e0e-565b-4471-957c-cc4bbf86fd0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.889150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac167e0e-565b-4471-957c-cc4bbf86fd0d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.900979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1041/2095] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:18.901846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac167e0e-565b-4471-957c-cc4bbf86fd0d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:18.909575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:18.914825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac167e0e-565b-4471-957c-cc4bbf86fd0d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:18.920556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78feb62a-9eaa-4e99-90df-78435d2cc619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:18.921516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feb62a-9eaa-4e99-90df-78435d2cc619 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:18.921890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feb62a-9eaa-4e99-90df-78435d2cc619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:18.922233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feb62a-9eaa-4e99-90df-78435d2cc619 admin admin] PATH_INFO: `/v3/projects/823981b45c5b42489fe16c8bc55d0576/users/39129c0d25654f11b0cb3adf6228a7ac/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:18.924294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feb62a-9eaa-4e99-90df-78435d2cc619 admin admin] RBAC: Authorizing `identity:create_grant(project_id=823981b45c5b42489fe16c8bc55d0576, user_id=39129c0d25654f11b0cb3adf6228a7ac, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:18.927068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feb62a-9eaa-4e99-90df-78435d2cc619 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:18.941265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1042/2096] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:18 2022] PUT /identity/v3/projects/823981b45c5b42489fe16c8bc55d0576/users/39129c0d25654f11b0cb3adf6228a7ac/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:18.941265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78feb62a-9eaa-4e99-90df-78435d2cc619 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:19.016609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78feb62a-9eaa-4e99-90df-78435d2cc619 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:19.023142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c06a9-24ad-4967-878b-93a703dbf62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:19.024073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c06a9-24ad-4967-878b-93a703dbf62b admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:19.024352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c06a9-24ad-4967-878b-93a703dbf62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:19.027347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c06a9-24ad-4967-878b-93a703dbf62b admin admin] PATH_INFO: `/v3/projects/593dd0569966485db33412a201d9b311/users/3437fb4f6caf4ba185cc10ce9f449353/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:19.037487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdbd1dc51d6f46e6bd6a380f3b3d3bb5', 'request_id': 'req-3d671beb-5104-493c-85bd-cd258efb7e24'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.043543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdbd1dc51d6f46e6bd6a380f3b3d3bb5', 'request_id': 'req-3d671beb-5104-493c-85bd-cd258efb7e24'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.045320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c06a9-24ad-4967-878b-93a703dbf62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=593dd0569966485db33412a201d9b311, user_id=3437fb4f6caf4ba185cc10ce9f449353, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:19.048106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05c06a9-24ad-4967-878b-93a703dbf62b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:19.172570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdbd1dc51d6f46e6bd6a380f3b3d3bb5', 'request_id': 'req-3d671beb-5104-493c-85bd-cd258efb7e24'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.178867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1043/2097] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:18 2022] PUT /identity/v3/projects/593dd0569966485db33412a201d9b311/users/3437fb4f6caf4ba185cc10ce9f449353/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:19.180322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c73c1-b9d7-4a8c-ae34-c363da4b6c39 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:19.180608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c73c1-b9d7-4a8c-ae34-c363da4b6c39 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:19.185420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c73c1-b9d7-4a8c-ae34-c363da4b6c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:19.187041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] The token cache is being invalidate because project bdbd1dc51d6f46e6bd6a380f3b3d3bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:19.187615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.188479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3d671beb-5104-493c-85bd-cd258efb7e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.190068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1055/2098] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:18 2022] DELETE /identity/v3/projects/bdbd1dc51d6f46e6bd6a380f3b3d3bb5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:19.191381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2fc8d-895f-4200-afb8-9b6253fb871c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:19.191667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2fc8d-895f-4200-afb8-9b6253fb871c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:19.191974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2fc8d-895f-4200-afb8-9b6253fb871c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:19.213634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c43c73c1-b9d7-4a8c-ae34-c363da4b6c39 None None] MFA Rules not processed for user `39129c0d25654f11b0cb3adf6228a7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:19.214934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c43c73c1-b9d7-4a8c-ae34-c363da4b6c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:19.220244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ebd2fc8d-895f-4200-afb8-9b6253fb871c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:19.221646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ebd2fc8d-895f-4200-afb8-9b6253fb871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:19.283885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1056/2099] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:19.288131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2fc8d-895f-4200-afb8-9b6253fb871c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:19.288638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1044/2100] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:19.289605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ebd2fc8d-895f-4200-afb8-9b6253fb871c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:19.294123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c73c1-b9d7-4a8c-ae34-c363da4b6c39 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:19.295797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c43c73c1-b9d7-4a8c-ae34-c363da4b6c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:19.303587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2fc8d-895f-4200-afb8-9b6253fb871c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:19.309410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:19.310061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:19.310340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:19.310609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] PATH_INFO: `/v3/users/6ec49413e9c041d7b68be1d7fbc466f5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:19.311843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec49413e9c041d7b68be1d7fbc466f5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:19.313768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:19.356287 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c73c1-b9d7-4a8c-ae34-c363da4b6c39 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:19.360635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e18533-6438-402b-ae90-c69d09b7e181 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:19.361258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:19.361389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e18533-6438-402b-ae90-c69d09b7e181 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:19.361992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e18533-6438-402b-ae90-c69d09b7e181 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:19.362294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e18533-6438-402b-ae90-c69d09b7e181 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:19.372537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e18533-6438-402b-ae90-c69d09b7e181 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:19.373986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e18533-6438-402b-ae90-c69d09b7e181 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:19.383997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1045/2101] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:19.384873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e18533-6438-402b-ae90-c69d09b7e181 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:19.386629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-03e18533-6438-402b-ae90-c69d09b7e181 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:19.448294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e18533-6438-402b-ae90-c69d09b7e181 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:19.454195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8d121-e5cb-4585-a55c-c458e7660116 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:19.454195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8d121-e5cb-4585-a55c-c458e7660116 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:19.454503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8d121-e5cb-4585-a55c-c458e7660116 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:19.454779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8d121-e5cb-4585-a55c-c458e7660116 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:19.464962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8d121-e5cb-4585-a55c-c458e7660116 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:19.467799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8d121-e5cb-4585-a55c-c458e7660116 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:19.483265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1046/2102] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:19.552540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8d121-e5cb-4585-a55c-c458e7660116 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:19.555992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a0a8d121-e5cb-4585-a55c-c458e7660116 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:19.565211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec49413e9c041d7b68be1d7fbc466f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.569803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8d121-e5cb-4585-a55c-c458e7660116 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:19.574653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:19.576340 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:19.576617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:19.576887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] PATH_INFO: `/v3/users/d45c2dd0d36940fa90996fc93b2bd0ee` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:19.578102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d45c2dd0d36940fa90996fc93b2bd0ee)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:19.580167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:19.640864 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec49413e9c041d7b68be1d7fbc466f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.646303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec49413e9c041d7b68be1d7fbc466f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.647114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec49413e9c041d7b68be1d7fbc466f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.661269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec49413e9c041d7b68be1d7fbc466f5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.668232 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1057/2103] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:19 2022] DELETE /identity/v3/users/6ec49413e9c041d7b68be1d7fbc466f5 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:19.674593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:19.674593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:19.755523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d687150-e183-4bd2-aa03-234b2d12581b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:19.755910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:19.757019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:19.757505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:19.757954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] PATH_INFO: `/v3/users/1a2bc0cc9df147db86994ab617145c58` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:19.759461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2bc0cc9df147db86994ab617145c58)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:19.762938 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:19.855060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd45c2dd0d36940fa90996fc93b2bd0ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.867207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd45c2dd0d36940fa90996fc93b2bd0ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.875082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd45c2dd0d36940fa90996fc93b2bd0ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.875883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd45c2dd0d36940fa90996fc93b2bd0ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:19.876526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-acbc3110-827f-4698-a7a1-a8fbcce105e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd45c2dd0d36940fa90996fc93b2bd0ee'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.067624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1047/2104] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:19 2022] DELETE /identity/v3/users/d45c2dd0d36940fa90996fc93b2bd0ee => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:20.069712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199948c7-1c53-4079-81f7-a322ec83c8d4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:20.071017 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199948c7-1c53-4079-81f7-a322ec83c8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:20.071438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199948c7-1c53-4079-81f7-a322ec83c8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:20.082833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2bc0cc9df147db86994ab617145c58'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.100643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-199948c7-1c53-4079-81f7-a322ec83c8d4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:20.102171 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-199948c7-1c53-4079-81f7-a322ec83c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:20.166996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1048/2105] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:20.173381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2bc0cc9df147db86994ab617145c58'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.179950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199948c7-1c53-4079-81f7-a322ec83c8d4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:20.183317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2bc0cc9df147db86994ab617145c58'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.183824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2bc0cc9df147db86994ab617145c58'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.184194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-199948c7-1c53-4079-81f7-a322ec83c8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:20.224210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2bc0cc9df147db86994ab617145c58'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.244412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1058/2106] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:19 2022] DELETE /identity/v3/users/1a2bc0cc9df147db86994ab617145c58 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:20.249308 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:20.251292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:20.268758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199948c7-1c53-4079-81f7-a322ec83c8d4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:20.330935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55748ea2-05b6-4280-bbb0-7601308ea306 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:20.337327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:20.338396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:20.338726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:20.339097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] PATH_INFO: `/v3/projects/20e646aef43246fba6a0e1bfb31888dd` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:20.341081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e646aef43246fba6a0e1bfb31888dd)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:20.343338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:20.349069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee51f8-dd02-4e3f-9038-889b2943475f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:20.349853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee51f8-dd02-4e3f-9038-889b2943475f service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:20.350588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee51f8-dd02-4e3f-9038-889b2943475f service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:20.350588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee51f8-dd02-4e3f-9038-889b2943475f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:20.352530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-15ee51f8-dd02-4e3f-9038-889b2943475f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:20.368494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee51f8-dd02-4e3f-9038-889b2943475f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:20.370026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee51f8-dd02-4e3f-9038-889b2943475f service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:20.381764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1049/2107] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:20.383188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becff26-9c69-4f2b-b4ad-70c4e5a22e5b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:20.384165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becff26-9c69-4f2b-b4ad-70c4e5a22e5b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:20.384478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becff26-9c69-4f2b-b4ad-70c4e5a22e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:20.404582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6becff26-9c69-4f2b-b4ad-70c4e5a22e5b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:20.406567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6becff26-9c69-4f2b-b4ad-70c4e5a22e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:20.415115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1050/2108] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:20.426375 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becff26-9c69-4f2b-b4ad-70c4e5a22e5b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:20.427969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6becff26-9c69-4f2b-b4ad-70c4e5a22e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:20.441219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becff26-9c69-4f2b-b4ad-70c4e5a22e5b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:20.445310 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23646bc9-d356-4f1f-bcbd-dac158f7fd81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:20.446218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23646bc9-d356-4f1f-bcbd-dac158f7fd81 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:20.446573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23646bc9-d356-4f1f-bcbd-dac158f7fd81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:20.446922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23646bc9-d356-4f1f-bcbd-dac158f7fd81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:20.460368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23646bc9-d356-4f1f-bcbd-dac158f7fd81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:20.461993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23646bc9-d356-4f1f-bcbd-dac158f7fd81 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:20.475442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e646aef43246fba6a0e1bfb31888dd', 'request_id': 'req-b847f8df-f9bd-41e1-84c8-4fc1c6163252'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.480164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1051/2109] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:11:20.482524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e646aef43246fba6a0e1bfb31888dd', 'request_id': 'req-b847f8df-f9bd-41e1-84c8-4fc1c6163252'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.554309 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e646aef43246fba6a0e1bfb31888dd', 'request_id': 'req-b847f8df-f9bd-41e1-84c8-4fc1c6163252'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.570298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] The token cache is being invalidate because project 20e646aef43246fba6a0e1bfb31888dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:20.571378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.572275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b847f8df-f9bd-41e1-84c8-4fc1c6163252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:20.585316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1059/2110] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:20 2022] DELETE /identity/v3/projects/20e646aef43246fba6a0e1bfb31888dd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:20.590253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226b250-2af6-48e1-901d-84d37f4e656f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:20.590945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226b250-2af6-48e1-901d-84d37f4e656f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:20.591085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226b250-2af6-48e1-901d-84d37f4e656f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:20.610604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3226b250-2af6-48e1-901d-84d37f4e656f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:20.611841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3226b250-2af6-48e1-901d-84d37f4e656f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:20.694105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1052/2111] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:20.703078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9cf41-2c62-4e03-97b8-8e65749d7d95 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:20.703370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9cf41-2c62-4e03-97b8-8e65749d7d95 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:20.703652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9cf41-2c62-4e03-97b8-8e65749d7d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:20.724751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-02c9cf41-2c62-4e03-97b8-8e65749d7d95 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:20.726042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-02c9cf41-2c62-4e03-97b8-8e65749d7d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:20.739897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1060/2112] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:20.744187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226b250-2af6-48e1-901d-84d37f4e656f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:20.756184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226b250-2af6-48e1-901d-84d37f4e656f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:20.763656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3bdfa-6d0a-496c-ac29-7c112be36d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:20.769190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3bdfa-6d0a-496c-ac29-7c112be36d3f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:20.769190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3bdfa-6d0a-496c-ac29-7c112be36d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:20.769190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c3bdfa-6d0a-496c-ac29-7c112be36d3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:20.769190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3bdfa-6d0a-496c-ac29-7c112be36d3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:20.769190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3bdfa-6d0a-496c-ac29-7c112be36d3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:20.769740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c3bdfa-6d0a-496c-ac29-7c112be36d3f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:20.785423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1053/2113] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:20.789072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9cf41-2c62-4e03-97b8-8e65749d7d95 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:20.800005 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c9cf41-2c62-4e03-97b8-8e65749d7d95 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:20.805114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25f572-e608-4b90-8fc2-d1f3889f7d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:20.805787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25f572-e608-4b90-8fc2-d1f3889f7d24 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:20.806069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25f572-e608-4b90-8fc2-d1f3889f7d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:20.806371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25f572-e608-4b90-8fc2-d1f3889f7d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:20.807284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25f572-e608-4b90-8fc2-d1f3889f7d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:20.809838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25f572-e608-4b90-8fc2-d1f3889f7d24 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:20.998818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1061/2114] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:20 2022] POST /identity/v3/projects => generated 387 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:21.002922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3bdfa-6d0a-496c-ac29-7c112be36d3f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:21.014116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c3bdfa-6d0a-496c-ac29-7c112be36d3f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:21.079185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc5cc2-3e24-444d-8ce5-5170317b55a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:21.080159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc5cc2-3e24-444d-8ce5-5170317b55a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:21.080617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc5cc2-3e24-444d-8ce5-5170317b55a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:21.081057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc5cc2-3e24-444d-8ce5-5170317b55a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:21.082326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc5cc2-3e24-444d-8ce5-5170317b55a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:21.085586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc5cc2-3e24-444d-8ce5-5170317b55a3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:21.139605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25f572-e608-4b90-8fc2-d1f3889f7d24 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:21.141542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8c25f572-e608-4b90-8fc2-d1f3889f7d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:21.155758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25f572-e608-4b90-8fc2-d1f3889f7d24 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:21.161121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:21.162261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:21.162562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:21.162818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] PATH_INFO: `/v3/projects/942cabe702854b22bf439c6f631130fc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:21.169284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] RBAC: Authorizing `identity:delete_project(project_id=942cabe702854b22bf439c6f631130fc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:21.169284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:21.218503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1054/2115] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:21 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:11:21.218503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc5cc2-3e24-444d-8ce5-5170317b55a3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:21.218503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a4fc5cc2-3e24-444d-8ce5-5170317b55a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:21.232794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc5cc2-3e24-444d-8ce5-5170317b55a3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:21.237899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:21.238916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:21.239205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:21.239567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] PATH_INFO: `/v3/projects/9fa4153852e6432fb30c63473d47a784` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:21.241277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa4153852e6432fb30c63473d47a784)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:21.243730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:21.341959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942cabe702854b22bf439c6f631130fc', 'request_id': 'req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:21.360559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942cabe702854b22bf439c6f631130fc', 'request_id': 'req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:21.450586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa4153852e6432fb30c63473d47a784', 'request_id': 'req-d26c0252-d057-4d20-98d2-3d666b9c5510'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:21.456567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa4153852e6432fb30c63473d47a784', 'request_id': 'req-d26c0252-d057-4d20-98d2-3d666b9c5510'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:21.468079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942cabe702854b22bf439c6f631130fc', 'request_id': 'req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:21.480898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] The token cache is being invalidate because project 942cabe702854b22bf439c6f631130fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:21.481743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:21.482595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:21.484250 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1062/2116] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:21 2022] DELETE /identity/v3/projects/942cabe702854b22bf439c6f631130fc => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:21.485044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:21.486324 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:21.557080 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9b1dc1-1776-4671-a5e2-9f8eb7ec7aad admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:21.594948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa4153852e6432fb30c63473d47a784', 'request_id': 'req-d26c0252-d057-4d20-98d2-3d666b9c5510'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:21.611745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] The token cache is being invalidate because project 9fa4153852e6432fb30c63473d47a784 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:21.612076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:21.612774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d26c0252-d057-4d20-98d2-3d666b9c5510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:21.617544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1055/2117] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:21 2022] DELETE /identity/v3/projects/9fa4153852e6432fb30c63473d47a784 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:21.619237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf9022-ae80-4e1a-9157-88743a0e5a02 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:21.619714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf9022-ae80-4e1a-9157-88743a0e5a02 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:21.620080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf9022-ae80-4e1a-9157-88743a0e5a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:21.627125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866847e5-e1e9-448e-9cd2-7fb30a0863c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:21.627867 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866847e5-e1e9-448e-9cd2-7fb30a0863c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:21.628114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866847e5-e1e9-448e-9cd2-7fb30a0863c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:21.628389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866847e5-e1e9-448e-9cd2-7fb30a0863c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:21.629782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866847e5-e1e9-448e-9cd2-7fb30a0863c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:21.630736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866847e5-e1e9-448e-9cd2-7fb30a0863c5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:21.643154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1063/2118] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:21 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:21.645254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866847e5-e1e9-448e-9cd2-7fb30a0863c5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:21.654397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-866847e5-e1e9-448e-9cd2-7fb30a0863c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:21.654549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ebdf9022-ae80-4e1a-9157-88743a0e5a02 None None] MFA Rules not processed for user `3437fb4f6caf4ba185cc10ce9f449353`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:21.654712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ebdf9022-ae80-4e1a-9157-88743a0e5a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:21.660351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866847e5-e1e9-448e-9cd2-7fb30a0863c5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:21.666379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:21.667610 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:21.668019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:21.668303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] PATH_INFO: `/v3/users/52bd8276d0114d5c8187fb9146c1481b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:21.670100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] RBAC: Authorizing `identity:delete_user(user_id=52bd8276d0114d5c8187fb9146c1481b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:21.672717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:21.709517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:21.733402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1056/2119] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:21.734270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf9022-ae80-4e1a-9157-88743a0e5a02 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:21.737977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ebdf9022-ae80-4e1a-9157-88743a0e5a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:21.755127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf9022-ae80-4e1a-9157-88743a0e5a02 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:21.760639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:21.761567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:21.761853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:21.762159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] PATH_INFO: `/v3/users/39129c0d25654f11b0cb3adf6228a7ac` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:21.763792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] RBAC: Authorizing `identity:delete_user(user_id=39129c0d25654f11b0cb3adf6228a7ac)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:21.765859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:21.893140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52bd8276d0114d5c8187fb9146c1481b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:22.035103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52bd8276d0114d5c8187fb9146c1481b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:22.043332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52bd8276d0114d5c8187fb9146c1481b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:22.044872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52bd8276d0114d5c8187fb9146c1481b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:22.058010 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52bd8276d0114d5c8187fb9146c1481b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:22.064755 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1064/2120] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:21 2022] DELETE /identity/v3/users/52bd8276d0114d5c8187fb9146c1481b => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:22.065570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:22.066900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:22.136089 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39129c0d25654f11b0cb3adf6228a7ac'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:22.154668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39129c0d25654f11b0cb3adf6228a7ac'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:22.156195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df475beb-2437-4f89-9d07-e0afe54239de admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:22.159478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39129c0d25654f11b0cb3adf6228a7ac'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:22.160283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39129c0d25654f11b0cb3adf6228a7ac'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:22.161023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39129c0d25654f11b0cb3adf6228a7ac'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:22.161154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c3c2c-bbee-4d27-aa4d-665e43b18536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:22.162081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c3c2c-bbee-4d27-aa4d-665e43b18536 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:22.162366 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c3c2c-bbee-4d27-aa4d-665e43b18536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:22.162641 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c3c2c-bbee-4d27-aa4d-665e43b18536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:22.163372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c3c2c-bbee-4d27-aa4d-665e43b18536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:22.165249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c3c2c-bbee-4d27-aa4d-665e43b18536 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:22.176876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1065/2121] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:22.178236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c3c2c-bbee-4d27-aa4d-665e43b18536 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:22.180505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a60c3c2c-bbee-4d27-aa4d-665e43b18536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:22.238404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c3c2c-bbee-4d27-aa4d-665e43b18536 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:22.242129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31717781-1189-46ff-950c-11581938930b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:22.242772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31717781-1189-46ff-950c-11581938930b service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:22.243078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31717781-1189-46ff-950c-11581938930b service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:22.243358 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31717781-1189-46ff-950c-11581938930b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:22.245154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-31717781-1189-46ff-950c-11581938930b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:22.305908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1057/2122] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:21 2022] DELETE /identity/v3/users/39129c0d25654f11b0cb3adf6228a7ac => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:22.309422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:22.311450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:22.328751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31717781-1189-46ff-950c-11581938930b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:22.330211 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31717781-1189-46ff-950c-11581938930b service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:22.344854 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1066/2123] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:22.415496 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4c3d9-9511-43c7-864a-e798d117152f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:22.423711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398c094-1f91-497c-b31b-131014f1238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:22.423711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c094-1f91-497c-b31b-131014f1238f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:22.423711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c094-1f91-497c-b31b-131014f1238f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:22.423711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398c094-1f91-497c-b31b-131014f1238f admin admin] PATH_INFO: `/v3/projects/da64a8c2678e4e979a2f7b2eb78e55e5/users/525a05230a094b0b9fff4f5258219761/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:22.444862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398c094-1f91-497c-b31b-131014f1238f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da64a8c2678e4e979a2f7b2eb78e55e5, user_id=525a05230a094b0b9fff4f5258219761, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:22.447835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398c094-1f91-497c-b31b-131014f1238f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:22.482033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=3,keystone:DELETE=4,keystone:SELECT=93 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:22.556996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1058/2124] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:22 2022] PUT /identity/v3/projects/da64a8c2678e4e979a2f7b2eb78e55e5/users/525a05230a094b0b9fff4f5258219761/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:22.570706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d218f-fe02-43ff-b32e-a8d2ce647985 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:22.571095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d218f-fe02-43ff-b32e-a8d2ce647985 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:22.571503 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d218f-fe02-43ff-b32e-a8d2ce647985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:22.602307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-656d218f-fe02-43ff-b32e-a8d2ce647985 None None] MFA Rules not processed for user `525a05230a094b0b9fff4f5258219761`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:22.603638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-656d218f-fe02-43ff-b32e-a8d2ce647985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:22.690650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1067/2125] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:22.707634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d218f-fe02-43ff-b32e-a8d2ce647985 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:22.707861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398c094-1f91-497c-b31b-131014f1238f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:22.709787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8398c094-1f91-497c-b31b-131014f1238f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:22.822600 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398c094-1f91-497c-b31b-131014f1238f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:22.828361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d218f-fe02-43ff-b32e-a8d2ce647985 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:22.828581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:22.829872 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:22.830353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:22.830810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] PATH_INFO: `/v3/projects/cca22e7378044bb7bd969a0e4a35970b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:22.832267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cca22e7378044bb7bd969a0e4a35970b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:22.834557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce34ac-a448-44bc-867d-92b17ca27ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:22.834712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:22.835219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce34ac-a448-44bc-867d-92b17ca27ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:22.835846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce34ac-a448-44bc-867d-92b17ca27ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:22.835976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ce34ac-a448-44bc-867d-92b17ca27ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:22.836623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce34ac-a448-44bc-867d-92b17ca27ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:22.839198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ce34ac-a448-44bc-867d-92b17ca27ce3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:23.007414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1068/2126] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:22 2022] POST /identity/v3/projects => generated 387 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:23.008154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce34ac-a448-44bc-867d-92b17ca27ce3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:23.010491 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e2ce34ac-a448-44bc-867d-92b17ca27ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:23.042269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cca22e7378044bb7bd969a0e4a35970b', 'request_id': 'req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:23.052293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cca22e7378044bb7bd969a0e4a35970b', 'request_id': 'req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:23.095234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ce34ac-a448-44bc-867d-92b17ca27ce3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:23.156689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:23.157642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.157847 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.158162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] PATH_INFO: `/v3/projects/823981b45c5b42489fe16c8bc55d0576` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.159859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=823981b45c5b42489fe16c8bc55d0576)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:23.161577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:23.177508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cca22e7378044bb7bd969a0e4a35970b', 'request_id': 'req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:23.197761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] The token cache is being invalidate because project cca22e7378044bb7bd969a0e4a35970b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:23.197983 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:23.200507 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:23.206567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1059/2127] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:22 2022] DELETE /identity/v3/projects/cca22e7378044bb7bd969a0e4a35970b => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:23.207602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:23.210916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:23.230093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3abdc-d433-4fef-8e71-84e4bdb58b4e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:23.235653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059eb4c8-2b14-49f4-8780-e4346189f189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:23.236767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb4c8-2b14-49f4-8780-e4346189f189 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.236883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb4c8-2b14-49f4-8780-e4346189f189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.237076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059eb4c8-2b14-49f4-8780-e4346189f189 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.237835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eb4c8-2b14-49f4-8780-e4346189f189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:23.239883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059eb4c8-2b14-49f4-8780-e4346189f189 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:23.337102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '823981b45c5b42489fe16c8bc55d0576', 'request_id': 'req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:23.348578 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '823981b45c5b42489fe16c8bc55d0576', 'request_id': 'req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:23.349683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1060/2128] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:23 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:23.352721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4496-39b0-4d7b-8bd8-15dd4fc76db0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.353380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4496-39b0-4d7b-8bd8-15dd4fc76db0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.354134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a4496-39b0-4d7b-8bd8-15dd4fc76db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.391953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-934a4496-39b0-4d7b-8bd8-15dd4fc76db0 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:23.394860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-934a4496-39b0-4d7b-8bd8-15dd4fc76db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:23.446827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '823981b45c5b42489fe16c8bc55d0576', 'request_id': 'req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:23.462078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] The token cache is being invalidate because project 823981b45c5b42489fe16c8bc55d0576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:23.462461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:23.463070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:23.464912 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1069/2129] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:23 2022] DELETE /identity/v3/projects/823981b45c5b42489fe16c8bc55d0576 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:23.466068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:23.467560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:23.496047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1061/2130] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:23.497918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f229b5-67dd-4437-831a-11664a034545 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.498136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f229b5-67dd-4437-831a-11664a034545 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.498409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f229b5-67dd-4437-831a-11664a034545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.519054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-02f229b5-67dd-4437-831a-11664a034545 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:23.520412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-02f229b5-67dd-4437-831a-11664a034545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:23.528869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1062/2131] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:23.530382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017cba5-0603-4f64-826a-5ef7ad90614b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.530656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017cba5-0603-4f64-826a-5ef7ad90614b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.530933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5017cba5-0603-4f64-826a-5ef7ad90614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.555704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb4f5ad-4260-4491-89e9-f9f61a4e60e8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:23.557536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5017cba5-0603-4f64-826a-5ef7ad90614b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:23.558366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5017cba5-0603-4f64-826a-5ef7ad90614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:23.561115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aaa83-2fca-46c1-890d-9a5754f5973e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:23.561789 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aaa83-2fca-46c1-890d-9a5754f5973e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.562080 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aaa83-2fca-46c1-890d-9a5754f5973e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.562355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38aaa83-2fca-46c1-890d-9a5754f5973e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.563537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38aaa83-2fca-46c1-890d-9a5754f5973e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:23.565319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38aaa83-2fca-46c1-890d-9a5754f5973e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:23.568390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1063/2132] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:23.569924 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522e693-739b-419d-905d-08cb9c2ac1dc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.570211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522e693-739b-419d-905d-08cb9c2ac1dc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.570486 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f522e693-739b-419d-905d-08cb9c2ac1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.583351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1070/2133] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:23.584932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aaa83-2fca-46c1-890d-9a5754f5973e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:23.590904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f522e693-739b-419d-905d-08cb9c2ac1dc None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:23.592545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f522e693-739b-419d-905d-08cb9c2ac1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:23.598252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38aaa83-2fca-46c1-890d-9a5754f5973e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:23.601533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1064/2134] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:23.601872 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522e693-739b-419d-905d-08cb9c2ac1dc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:23.607243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c10f1-7863-4815-b012-32f9c14acea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:23.607912 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c10f1-7863-4815-b012-32f9c14acea0 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.608222 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c10f1-7863-4815-b012-32f9c14acea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.608493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c10f1-7863-4815-b012-32f9c14acea0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.609278 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c10f1-7863-4815-b012-32f9c14acea0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:23.609590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c10f1-7863-4815-b012-32f9c14acea0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:23.611190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c10f1-7863-4815-b012-32f9c14acea0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:23.613509 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f522e693-739b-419d-905d-08cb9c2ac1dc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:23.619666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a26c5-8530-494f-b235-50d054e59ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:23.621292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a26c5-8530-494f-b235-50d054e59ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.622645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a26c5-8530-494f-b235-50d054e59ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.625729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a26c5-8530-494f-b235-50d054e59ae1 admin admin] PATH_INFO: `/v3/projects/85eed27b89e3415c93de7b078f86c237/users/8a43ed70e468453ea39748f96742a14b/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.625887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1071/2135] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:23.625887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c10f1-7863-4815-b012-32f9c14acea0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:23.638208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c10f1-7863-4815-b012-32f9c14acea0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:23.640372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a26c5-8530-494f-b235-50d054e59ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85eed27b89e3415c93de7b078f86c237, user_id=8a43ed70e468453ea39748f96742a14b, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:23.643069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c903995-c197-4e04-83af-a8acd0718aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:23.643490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025a26c5-8530-494f-b235-50d054e59ae1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:23.643768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c903995-c197-4e04-83af-a8acd0718aca admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.644313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c903995-c197-4e04-83af-a8acd0718aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.644589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c903995-c197-4e04-83af-a8acd0718aca admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.645311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c903995-c197-4e04-83af-a8acd0718aca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:23.645616 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c903995-c197-4e04-83af-a8acd0718aca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:23.647235 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c903995-c197-4e04-83af-a8acd0718aca admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:23.660594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1072/2136] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:23.662041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c903995-c197-4e04-83af-a8acd0718aca admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:23.672631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c903995-c197-4e04-83af-a8acd0718aca admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:23.677357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ade5fa-d241-44eb-ab96-041a1a78c994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:23.677999 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ade5fa-d241-44eb-ab96-041a1a78c994 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.678277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ade5fa-d241-44eb-ab96-041a1a78c994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.678546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ade5fa-d241-44eb-ab96-041a1a78c994 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.679313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ade5fa-d241-44eb-ab96-041a1a78c994 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:23.681265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ade5fa-d241-44eb-ab96-041a1a78c994 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:23.744528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1065/2137] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:23 2022] PUT /identity/v3/projects/85eed27b89e3415c93de7b078f86c237/users/8a43ed70e468453ea39748f96742a14b/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:23.745477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a26c5-8530-494f-b235-50d054e59ae1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:23.801498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1073/2138] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:23 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:23.802401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ade5fa-d241-44eb-ab96-041a1a78c994 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:23.820288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a26c5-8530-494f-b235-50d054e59ae1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:23.893378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ade5fa-d241-44eb-ab96-041a1a78c994 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:23.901305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7bdf4-529f-441c-ba35-e687ec53aa0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:23.901305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7bdf4-529f-441c-ba35-e687ec53aa0c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.901305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7bdf4-529f-441c-ba35-e687ec53aa0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.901305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7bdf4-529f-441c-ba35-e687ec53aa0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.901993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7bdf4-529f-441c-ba35-e687ec53aa0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:23.904231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7bdf4-529f-441c-ba35-e687ec53aa0c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:23.916021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50953e-9ecc-4c4f-93ed-be0a64e70055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:23.916831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50953e-9ecc-4c4f-93ed-be0a64e70055 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.917117 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50953e-9ecc-4c4f-93ed-be0a64e70055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.917391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50953e-9ecc-4c4f-93ed-be0a64e70055 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.925602 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1074/2139] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:23.925938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50953e-9ecc-4c4f-93ed-be0a64e70055 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:23.926519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7bdf4-529f-441c-ba35-e687ec53aa0c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:23.928019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50953e-9ecc-4c4f-93ed-be0a64e70055 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:23.942142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7bdf4-529f-441c-ba35-e687ec53aa0c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:23.954532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f0b7-b281-4587-bd36-3de668a1802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:23.955199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f0b7-b281-4587-bd36-3de668a1802f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:23.956147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f0b7-b281-4587-bd36-3de668a1802f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:23.956147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d9f0b7-b281-4587-bd36-3de668a1802f admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:23.956552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9f0b7-b281-4587-bd36-3de668a1802f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:23.958736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d9f0b7-b281-4587-bd36-3de668a1802f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:24.093965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1075/2140] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:23 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:24.095621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f0b7-b281-4587-bd36-3de668a1802f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:24.097447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1066/2141] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:23 2022] POST /identity/v3/projects => generated 367 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:24.101379 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50953e-9ecc-4c4f-93ed-be0a64e70055 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:24.107702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d9f0b7-b281-4587-bd36-3de668a1802f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:24.168034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50953e-9ecc-4c4f-93ed-be0a64e70055 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:24.170410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699f654-c918-4812-9d68-12780555e10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:24.171328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699f654-c918-4812-9d68-12780555e10d admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.171660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699f654-c918-4812-9d68-12780555e10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.171960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699f654-c918-4812-9d68-12780555e10d admin admin] PATH_INFO: `/v3/projects/85eed27b89e3415c93de7b078f86c237/users/8a43ed70e468453ea39748f96742a14b/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.173969 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699f654-c918-4812-9d68-12780555e10d admin admin] RBAC: Authorizing `identity:create_grant(project_id=85eed27b89e3415c93de7b078f86c237, user_id=8a43ed70e468453ea39748f96742a14b, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:24.176275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be3e79-15a3-4277-9a77-dacd63f7b3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:24.176660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699f654-c918-4812-9d68-12780555e10d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:24.176963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be3e79-15a3-4277-9a77-dacd63f7b3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.177252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be3e79-15a3-4277-9a77-dacd63f7b3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.177535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be3e79-15a3-4277-9a77-dacd63f7b3f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.178234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be3e79-15a3-4277-9a77-dacd63f7b3f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:24.180196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be3e79-15a3-4277-9a77-dacd63f7b3f5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:24.187859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1076/2142] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:24 2022] PUT /identity/v3/projects/85eed27b89e3415c93de7b078f86c237/users/8a43ed70e468453ea39748f96742a14b/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:24.188588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699f654-c918-4812-9d68-12780555e10d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:24.260044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699f654-c918-4812-9d68-12780555e10d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:24.265009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0845ef-f1e5-4639-955e-fb850bc31411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:24.265665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0845ef-f1e5-4639-955e-fb850bc31411 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.266001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0845ef-f1e5-4639-955e-fb850bc31411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.266218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0845ef-f1e5-4639-955e-fb850bc31411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.266940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0845ef-f1e5-4639-955e-fb850bc31411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:24.268639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0845ef-f1e5-4639-955e-fb850bc31411 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:24.279719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1077/2143] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:24.280688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a5565-b0ae-4c25-9d71-714a6b53d618 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.280974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a5565-b0ae-4c25-9d71-714a6b53d618 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.281261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831a5565-b0ae-4c25-9d71-714a6b53d618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.308980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-831a5565-b0ae-4c25-9d71-714a6b53d618 None None] MFA Rules not processed for user `8a43ed70e468453ea39748f96742a14b`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:24.310289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-831a5565-b0ae-4c25-9d71-714a6b53d618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:24.386633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1067/2144] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:24 2022] POST /identity/v3/users => generated 284 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:24.388203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be3e79-15a3-4277-9a77-dacd63f7b3f5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:24.399211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be3e79-15a3-4277-9a77-dacd63f7b3f5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:24.405038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72fd7-2162-4e6f-8682-422f778eb0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:24.405740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72fd7-2162-4e6f-8682-422f778eb0fc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.406025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72fd7-2162-4e6f-8682-422f778eb0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.406303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a72fd7-2162-4e6f-8682-422f778eb0fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.410365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1078/2145] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:24.410526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a72fd7-2162-4e6f-8682-422f778eb0fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:24.410628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4831-59b1-41cf-b127-289aa4fad347 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.410628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4831-59b1-41cf-b127-289aa4fad347 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.410628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4831-59b1-41cf-b127-289aa4fad347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.410913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a72fd7-2162-4e6f-8682-422f778eb0fc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:24.427978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1068/2146] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:24.427978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72fd7-2162-4e6f-8682-422f778eb0fc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:24.436846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6bbd4831-59b1-41cf-b127-289aa4fad347 None None] MFA Rules not processed for user `3437fb4f6caf4ba185cc10ce9f449353`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:24.438316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6bbd4831-59b1-41cf-b127-289aa4fad347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:24.444328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a72fd7-2162-4e6f-8682-422f778eb0fc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:24.460092 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42cc8f-a3fa-46df-94cc-37f4d366316a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:24.461025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42cc8f-a3fa-46df-94cc-37f4d366316a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.461471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42cc8f-a3fa-46df-94cc-37f4d366316a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.461755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42cc8f-a3fa-46df-94cc-37f4d366316a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.462497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42cc8f-a3fa-46df-94cc-37f4d366316a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:24.464152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42cc8f-a3fa-46df-94cc-37f4d366316a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:24.486600 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1069/2147] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:24.487729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42cc8f-a3fa-46df-94cc-37f4d366316a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:24.492384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-da42cc8f-a3fa-46df-94cc-37f4d366316a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:24.524637 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1079/2148] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:24.524637 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd4831-59b1-41cf-b127-289aa4fad347 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:24.545251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd4831-59b1-41cf-b127-289aa4fad347 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:24.554988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddfc45b-976f-4b09-aab6-e07ed6e6282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:24.557085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc45b-976f-4b09-aab6-e07ed6e6282f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.557848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc45b-976f-4b09-aab6-e07ed6e6282f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.558280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddfc45b-976f-4b09-aab6-e07ed6e6282f admin admin] PATH_INFO: `/v3/projects/dbd4635d047b46139e1df4b93c3c61fd/users/f1a5b8abb0254ad487eb645180c26ca7/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.581216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfc45b-976f-4b09-aab6-e07ed6e6282f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd4635d047b46139e1df4b93c3c61fd, user_id=f1a5b8abb0254ad487eb645180c26ca7, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:24.581475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42cc8f-a3fa-46df-94cc-37f4d366316a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:24.585465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0892c-764f-42f4-a4a7-7bb3698872ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:24.585660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddfc45b-976f-4b09-aab6-e07ed6e6282f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:24.586649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0892c-764f-42f4-a4a7-7bb3698872ce service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.587379 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0892c-764f-42f4-a4a7-7bb3698872ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.587599 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0892c-764f-42f4-a4a7-7bb3698872ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.599166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0892c-764f-42f4-a4a7-7bb3698872ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:24.600654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0892c-764f-42f4-a4a7-7bb3698872ce service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:24.611735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1070/2149] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:24.612650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0892c-764f-42f4-a4a7-7bb3698872ce service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:24.624314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0892c-764f-42f4-a4a7-7bb3698872ce service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:24.635334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f2783-5b48-4a7f-95b4-cc96d8a2ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:24.635946 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2783-5b48-4a7f-95b4-cc96d8a2ff7b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.636234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2783-5b48-4a7f-95b4-cc96d8a2ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.636510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501f2783-5b48-4a7f-95b4-cc96d8a2ff7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.638215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f2783-5b48-4a7f-95b4-cc96d8a2ff7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:24.639941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501f2783-5b48-4a7f-95b4-cc96d8a2ff7b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:24.652142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1071/2150] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:24.656170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f2783-5b48-4a7f-95b4-cc96d8a2ff7b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:24.666906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501f2783-5b48-4a7f-95b4-cc96d8a2ff7b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:24.673752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422069d2-1ad2-45ba-afdf-bcfe5b637f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:24.677913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422069d2-1ad2-45ba-afdf-bcfe5b637f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.677913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422069d2-1ad2-45ba-afdf-bcfe5b637f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.677913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422069d2-1ad2-45ba-afdf-bcfe5b637f69 admin admin] PATH_INFO: `/v3/projects/ce5fcdf7d3054622b208722b34ca4327/users/b5ec53ef3beb428f8b5b4c855b107dc7/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.693221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422069d2-1ad2-45ba-afdf-bcfe5b637f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce5fcdf7d3054622b208722b34ca4327, user_id=b5ec53ef3beb428f8b5b4c855b107dc7, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:24.695899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422069d2-1ad2-45ba-afdf-bcfe5b637f69 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:24.709784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1080/2151] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:24 2022] PUT /identity/v3/projects/dbd4635d047b46139e1df4b93c3c61fd/users/f1a5b8abb0254ad487eb645180c26ca7/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:24.723025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073580c-26ec-4817-82e9-db6002e36065 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.723318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073580c-26ec-4817-82e9-db6002e36065 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.723605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073580c-26ec-4817-82e9-db6002e36065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.751711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0073580c-26ec-4817-82e9-db6002e36065 None None] MFA Rules not processed for user `f1a5b8abb0254ad487eb645180c26ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:24.753234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0073580c-26ec-4817-82e9-db6002e36065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:24.848732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1072/2152] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:24 2022] PUT /identity/v3/projects/ce5fcdf7d3054622b208722b34ca4327/users/b5ec53ef3beb428f8b5b4c855b107dc7/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:24.851540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccd768-a3e0-475b-98b1-754fef22c72b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:24.852024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccd768-a3e0-475b-98b1-754fef22c72b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:24.852361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccd768-a3e0-475b-98b1-754fef22c72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:24.852998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1081/2153] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:24.862169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073580c-26ec-4817-82e9-db6002e36065 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:24.896027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4bccd768-a3e0-475b-98b1-754fef22c72b None None] MFA Rules not processed for user `b5ec53ef3beb428f8b5b4c855b107dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:24.897860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4bccd768-a3e0-475b-98b1-754fef22c72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:24.931093 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073580c-26ec-4817-82e9-db6002e36065 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:24.985854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1073/2154] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:24.989846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccd768-a3e0-475b-98b1-754fef22c72b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:25.006548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e1a7-e1a3-4922-8f76-6b7bc649153c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:25.007197 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e1a7-e1a3-4922-8f76-6b7bc649153c service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:25.007475 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e1a7-e1a3-4922-8f76-6b7bc649153c service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:25.007744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e1a7-e1a3-4922-8f76-6b7bc649153c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:25.068560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bccd768-a3e0-475b-98b1-754fef22c72b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:25.078489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c1b80-a9b4-4f25-b01f-9dba030b4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:25.078988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c1b80-a9b4-4f25-b01f-9dba030b4d03 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:25.080631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c1b80-a9b4-4f25-b01f-9dba030b4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:25.080987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173c1b80-a9b4-4f25-b01f-9dba030b4d03 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:25.082291 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c1b80-a9b4-4f25-b01f-9dba030b4d03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:25.089225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173c1b80-a9b4-4f25-b01f-9dba030b4d03 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:25.117057 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353e1a7-e1a3-4922-8f76-6b7bc649153c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:25.118508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353e1a7-e1a3-4922-8f76-6b7bc649153c service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:25.129266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1082/2155] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:25.155360 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:25.216442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1074/2156] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:24 2022] POST /identity/v3/projects => generated 367 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:11:25.220687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e1a7-e1a3-4922-8f76-6b7bc649153c service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:25.232996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e1a7-e1a3-4922-8f76-6b7bc649153c service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:25.318924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb660697-9ab1-4976-a66f-9fef886c3e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:25.320666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660697-9ab1-4976-a66f-9fef886c3e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:25.321167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660697-9ab1-4976-a66f-9fef886c3e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:25.321688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb660697-9ab1-4976-a66f-9fef886c3e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:25.323198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb660697-9ab1-4976-a66f-9fef886c3e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:25.326889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb660697-9ab1-4976-a66f-9fef886c3e3e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:25.520615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1083/2157] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:25 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:25.521285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c1b80-a9b4-4f25-b01f-9dba030b4d03 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:25.533612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173c1b80-a9b4-4f25-b01f-9dba030b4d03 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:25.541764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dc58e-83ba-491f-a690-f4656c6235f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:25.542495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dc58e-83ba-491f-a690-f4656c6235f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:25.542781 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dc58e-83ba-491f-a690-f4656c6235f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:25.551296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061dc58e-83ba-491f-a690-f4656c6235f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:25.551296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061dc58e-83ba-491f-a690-f4656c6235f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:25.551296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061dc58e-83ba-491f-a690-f4656c6235f5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:25.569030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1075/2158] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:25.569821 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb660697-9ab1-4976-a66f-9fef886c3e3e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:25.581159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb660697-9ab1-4976-a66f-9fef886c3e3e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:25.589021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b86ba-df6f-475a-a8f6-d9cbe8a39bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:25.589021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b86ba-df6f-475a-a8f6-d9cbe8a39bef admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:25.589021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b86ba-df6f-475a-a8f6-d9cbe8a39bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:25.589021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b86ba-df6f-475a-a8f6-d9cbe8a39bef admin admin] PATH_INFO: `/v3/projects/403a7ecb31a84e92bc8457ab72a9ba70/users/5aabff0cded040e5977c5e47a458e546/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:25.610402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b86ba-df6f-475a-a8f6-d9cbe8a39bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=403a7ecb31a84e92bc8457ab72a9ba70, user_id=5aabff0cded040e5977c5e47a458e546, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:25.613575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545b86ba-df6f-475a-a8f6-d9cbe8a39bef admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:25.772455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1084/2159] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:25 2022] PUT /identity/v3/projects/403a7ecb31a84e92bc8457ab72a9ba70/users/5aabff0cded040e5977c5e47a458e546/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:25.773564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dc58e-83ba-491f-a690-f4656c6235f5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:25.784896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061dc58e-83ba-491f-a690-f4656c6235f5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:25.842967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:25.855202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a990d1-a4cd-49a4-b199-1498ad5fe122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:25.860957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a990d1-a4cd-49a4-b199-1498ad5fe122 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:25.860957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a990d1-a4cd-49a4-b199-1498ad5fe122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:25.860957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a990d1-a4cd-49a4-b199-1498ad5fe122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:25.860957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a990d1-a4cd-49a4-b199-1498ad5fe122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:25.860957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a990d1-a4cd-49a4-b199-1498ad5fe122 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:25.873820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1076/2160] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:11:25.875136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b86ba-df6f-475a-a8f6-d9cbe8a39bef admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:25.886372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b86ba-df6f-475a-a8f6-d9cbe8a39bef admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:25.891877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb83eb9-3f23-4504-87ac-ab1a4b8bf67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:25.906834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb83eb9-3f23-4504-87ac-ab1a4b8bf67b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:25.906834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb83eb9-3f23-4504-87ac-ab1a4b8bf67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:25.906834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb83eb9-3f23-4504-87ac-ab1a4b8bf67b admin admin] PATH_INFO: `/v3/projects/403a7ecb31a84e92bc8457ab72a9ba70/users/5aabff0cded040e5977c5e47a458e546/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:25.906834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb83eb9-3f23-4504-87ac-ab1a4b8bf67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=403a7ecb31a84e92bc8457ab72a9ba70, user_id=5aabff0cded040e5977c5e47a458e546, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:25.906834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb83eb9-3f23-4504-87ac-ab1a4b8bf67b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:25.909705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1085/2161] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:25 2022] PUT /identity/v3/projects/403a7ecb31a84e92bc8457ab72a9ba70/users/5aabff0cded040e5977c5e47a458e546/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:25.922276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573f5b-605b-4c86-a58f-8b75331fe613 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:25.922572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573f5b-605b-4c86-a58f-8b75331fe613 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:25.922856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84573f5b-605b-4c86-a58f-8b75331fe613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:25.984578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-84573f5b-605b-4c86-a58f-8b75331fe613 None None] MFA Rules not processed for user `5aabff0cded040e5977c5e47a458e546`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:25.985839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-84573f5b-605b-4c86-a58f-8b75331fe613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:26.091819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1077/2162] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:25 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:26.152283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb83eb9-3f23-4504-87ac-ab1a4b8bf67b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:26.230030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb83eb9-3f23-4504-87ac-ab1a4b8bf67b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:26.235223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b663b-3c2d-453f-8f5b-94561e6b3637 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:26.235884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b663b-3c2d-453f-8f5b-94561e6b3637 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:26.236208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b663b-3c2d-453f-8f5b-94561e6b3637 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:26.236480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5b663b-3c2d-453f-8f5b-94561e6b3637 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:26.248368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b663b-3c2d-453f-8f5b-94561e6b3637 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:26.249828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5b663b-3c2d-453f-8f5b-94561e6b3637 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:26.261157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1086/2163] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:26.562773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84573f5b-605b-4c86-a58f-8b75331fe613 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:26.572628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84573f5b-605b-4c86-a58f-8b75331fe613 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:26.577148 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56a967-843a-45db-94c3-3aeb3258d3d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:26.578048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56a967-843a-45db-94c3-3aeb3258d3d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:26.578455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56a967-843a-45db-94c3-3aeb3258d3d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:26.578942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56a967-843a-45db-94c3-3aeb3258d3d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:26.639531 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56a967-843a-45db-94c3-3aeb3258d3d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:26.641043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56a967-843a-45db-94c3-3aeb3258d3d6 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:26.650115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1078/2164] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:26 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:26.690860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b663b-3c2d-453f-8f5b-94561e6b3637 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:26.760525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5b663b-3c2d-453f-8f5b-94561e6b3637 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:26.765753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:26.766643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:26.766924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:26.767199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] PATH_INFO: `/v3/users/525a05230a094b0b9fff4f5258219761` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:26.768670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=525a05230a094b0b9fff4f5258219761)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:26.771318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:27.183946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '525a05230a094b0b9fff4f5258219761'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:27.356877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb913f19-3a45-41e6-83ff-98f645b648d7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:27.357441 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb913f19-3a45-41e6-83ff-98f645b648d7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:27.357541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb913f19-3a45-41e6-83ff-98f645b648d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:27.372876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '525a05230a094b0b9fff4f5258219761'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:27.378781 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bb913f19-3a45-41e6-83ff-98f645b648d7 None None] MFA Rules not processed for user `f1a5b8abb0254ad487eb645180c26ca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:27.381725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bb913f19-3a45-41e6-83ff-98f645b648d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:27.382638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '525a05230a094b0b9fff4f5258219761'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:27.383354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '525a05230a094b0b9fff4f5258219761'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:27.395760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e5ace8d8-7c44-4c87-9ef3-cd2c99cbd003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '525a05230a094b0b9fff4f5258219761'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:27.402476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1087/2165] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:26 2022] DELETE /identity/v3/users/525a05230a094b0b9fff4f5258219761 => generated 0 bytes in 712 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:27.407446 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21f0a-a68b-45f2-ab41-a2a4713e0dd9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:27.407736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21f0a-a68b-45f2-ab41-a2a4713e0dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:27.408052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c21f0a-a68b-45f2-ab41-a2a4713e0dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:27.429530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d7c21f0a-a68b-45f2-ab41-a2a4713e0dd9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:27.430726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d7c21f0a-a68b-45f2-ab41-a2a4713e0dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:27.440457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1079/2166] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:27.494677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1088/2167] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:27.504728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb913f19-3a45-41e6-83ff-98f645b648d7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:27.506250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bb913f19-3a45-41e6-83ff-98f645b648d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:27.569430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb913f19-3a45-41e6-83ff-98f645b648d7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:27.625917 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c031a-740f-4ccc-8edc-1fda02c2ea8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:27.626582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c031a-740f-4ccc-8edc-1fda02c2ea8d service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:27.626867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c031a-740f-4ccc-8edc-1fda02c2ea8d service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:27.627142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c031a-740f-4ccc-8edc-1fda02c2ea8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:27.646781 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c031a-740f-4ccc-8edc-1fda02c2ea8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:27.648489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8c031a-740f-4ccc-8edc-1fda02c2ea8d service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:27.665213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1080/2168] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:28.655012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c21f0a-a68b-45f2-ab41-a2a4713e0dd9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:28.656772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d7c21f0a-a68b-45f2-ab41-a2a4713e0dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:28.671450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c21f0a-a68b-45f2-ab41-a2a4713e0dd9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:28.676876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028862d5-0986-4113-a747-3472fea706df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:28.677754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028862d5-0986-4113-a747-3472fea706df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:28.678087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028862d5-0986-4113-a747-3472fea706df admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:28.678287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028862d5-0986-4113-a747-3472fea706df admin admin] PATH_INFO: `/v3/projects/da64a8c2678e4e979a2f7b2eb78e55e5` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:28.679580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028862d5-0986-4113-a747-3472fea706df admin admin] RBAC: Authorizing `identity:delete_project(project_id=da64a8c2678e4e979a2f7b2eb78e55e5)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:28.681722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028862d5-0986-4113-a747-3472fea706df admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:28.825165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-028862d5-0986-4113-a747-3472fea706df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da64a8c2678e4e979a2f7b2eb78e55e5', 'request_id': 'req-028862d5-0986-4113-a747-3472fea706df'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:28.831976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-028862d5-0986-4113-a747-3472fea706df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da64a8c2678e4e979a2f7b2eb78e55e5', 'request_id': 'req-028862d5-0986-4113-a747-3472fea706df'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:28.952196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-028862d5-0986-4113-a747-3472fea706df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da64a8c2678e4e979a2f7b2eb78e55e5', 'request_id': 'req-028862d5-0986-4113-a747-3472fea706df'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:28.964482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-028862d5-0986-4113-a747-3472fea706df admin admin] The token cache is being invalidate because project da64a8c2678e4e979a2f7b2eb78e55e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:28.964770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-028862d5-0986-4113-a747-3472fea706df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:28.966043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-028862d5-0986-4113-a747-3472fea706df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:28.967879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1089/2169] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:28 2022] DELETE /identity/v3/projects/da64a8c2678e4e979a2f7b2eb78e55e5 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:28.972057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c031a-740f-4ccc-8edc-1fda02c2ea8d service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:28.982123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c031a-740f-4ccc-8edc-1fda02c2ea8d service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:29.044326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:29.045199 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:29.045480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:29.045755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] PATH_INFO: `/v3/users/8a43ed70e468453ea39748f96742a14b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:29.046936 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a43ed70e468453ea39748f96742a14b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:29.048900 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:29.415673 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:29.422676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a43ed70e468453ea39748f96742a14b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:29.438472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a43ed70e468453ea39748f96742a14b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:29.446084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a43ed70e468453ea39748f96742a14b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:29.446841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a43ed70e468453ea39748f96742a14b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:29.448346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5396d6f0-7f47-4546-9bcb-dd5b27d633ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a43ed70e468453ea39748f96742a14b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:29.612802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1081/2170] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:28 2022] DELETE /identity/v3/users/8a43ed70e468453ea39748f96742a14b => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:30.032716 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:30.278139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028862d5-0986-4113-a747-3472fea706df admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:30.280180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-028862d5-0986-4113-a747-3472fea706df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:30.301366 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028862d5-0986-4113-a747-3472fea706df admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:30.368699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:30.369576 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:30.369857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:30.370166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] PATH_INFO: `/v3/projects/85eed27b89e3415c93de7b078f86c237` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:30.371460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85eed27b89e3415c93de7b078f86c237)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:30.373500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:30.522450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85eed27b89e3415c93de7b078f86c237', 'request_id': 'req-21f78970-24e6-41fb-85af-62e3fe913302'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:30.531156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85eed27b89e3415c93de7b078f86c237', 'request_id': 'req-21f78970-24e6-41fb-85af-62e3fe913302'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:30.625266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85eed27b89e3415c93de7b078f86c237', 'request_id': 'req-21f78970-24e6-41fb-85af-62e3fe913302'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:30.647817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] The token cache is being invalidate because project 85eed27b89e3415c93de7b078f86c237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:30.648311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:30.649376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-21f78970-24e6-41fb-85af-62e3fe913302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:30.651674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1090/2171] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:30 2022] DELETE /identity/v3/projects/85eed27b89e3415c93de7b078f86c237 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:30.657426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e543349-90b1-4c9a-80af-138d46d1f252 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:30.657765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e543349-90b1-4c9a-80af-138d46d1f252 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:30.660786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e543349-90b1-4c9a-80af-138d46d1f252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:30.677638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3e543349-90b1-4c9a-80af-138d46d1f252 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:30.678899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3e543349-90b1-4c9a-80af-138d46d1f252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:30.753432 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1082/2172] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:30.754478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6c5c6-cd6e-497a-af31-50cc7486f0aa None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:30.754769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6c5c6-cd6e-497a-af31-50cc7486f0aa None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:30.755058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6c5c6-cd6e-497a-af31-50cc7486f0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:30.778996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-4bc6c5c6-cd6e-497a-af31-50cc7486f0aa None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:30.780836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4bc6c5c6-cd6e-497a-af31-50cc7486f0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:30.795189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e543349-90b1-4c9a-80af-138d46d1f252 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:30.808438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1091/2173] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:30.817562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e543349-90b1-4c9a-80af-138d46d1f252 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:30.823086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd53ae4-2c7f-42bd-b5eb-c9ad9534dd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:30.823829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd53ae4-2c7f-42bd-b5eb-c9ad9534dd2f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:30.824220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd53ae4-2c7f-42bd-b5eb-c9ad9534dd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:30.825273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd53ae4-2c7f-42bd-b5eb-c9ad9534dd2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:30.826651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd53ae4-2c7f-42bd-b5eb-c9ad9534dd2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:30.827041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd53ae4-2c7f-42bd-b5eb-c9ad9534dd2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:30.829371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd53ae4-2c7f-42bd-b5eb-c9ad9534dd2f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:30.843633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1083/2174] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:30.848299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6c5c6-cd6e-497a-af31-50cc7486f0aa None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:30.860470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6c5c6-cd6e-497a-af31-50cc7486f0aa None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:30.866155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3a837-40d1-4466-a60e-011e975db224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:30.874201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a837-40d1-4466-a60e-011e975db224 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:30.874201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a837-40d1-4466-a60e-011e975db224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:30.874201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca3a837-40d1-4466-a60e-011e975db224 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:30.874201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a837-40d1-4466-a60e-011e975db224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:30.874201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca3a837-40d1-4466-a60e-011e975db224 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:31.003454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1092/2175] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:30 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:31.006517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd53ae4-2c7f-42bd-b5eb-c9ad9534dd2f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:31.028255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd53ae4-2c7f-42bd-b5eb-c9ad9534dd2f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:31.087024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5d5f7-6e6b-400d-b927-dba78fe027af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:31.087886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5d5f7-6e6b-400d-b927-dba78fe027af admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:31.088104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5d5f7-6e6b-400d-b927-dba78fe027af admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:31.088382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5d5f7-6e6b-400d-b927-dba78fe027af admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:31.089093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5d5f7-6e6b-400d-b927-dba78fe027af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:31.092322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5d5f7-6e6b-400d-b927-dba78fe027af admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:31.183557 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1084/2176] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:31 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:31.188664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3a837-40d1-4466-a60e-011e975db224 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:31.200790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca3a837-40d1-4466-a60e-011e975db224 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:31.205480 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b7ac7-dd8c-44c9-865d-0f5a77223397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:31.206138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b7ac7-dd8c-44c9-865d-0f5a77223397 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:31.206417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b7ac7-dd8c-44c9-865d-0f5a77223397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:31.206687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0b7ac7-dd8c-44c9-865d-0f5a77223397 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:31.207439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b7ac7-dd8c-44c9-865d-0f5a77223397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:31.209047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0b7ac7-dd8c-44c9-865d-0f5a77223397 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:31.221194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:31.221378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1093/2177] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:31.223879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5d5f7-6e6b-400d-b927-dba78fe027af admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:31.237065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5d5f7-6e6b-400d-b927-dba78fe027af admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:31.241921 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a719ff-702f-449b-a537-5f9eb96301aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:31.242578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a719ff-702f-449b-a537-5f9eb96301aa admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:31.242889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a719ff-702f-449b-a537-5f9eb96301aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:31.243195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a719ff-702f-449b-a537-5f9eb96301aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:31.244022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a719ff-702f-449b-a537-5f9eb96301aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:31.245747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a719ff-702f-449b-a537-5f9eb96301aa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:31.255972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1085/2178] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:31.261053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b7ac7-dd8c-44c9-865d-0f5a77223397 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:31.271651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0b7ac7-dd8c-44c9-865d-0f5a77223397 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:31.276285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa828514-fa2b-4ea2-a366-470d9b1e5924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:31.277180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828514-fa2b-4ea2-a366-470d9b1e5924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:31.277476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828514-fa2b-4ea2-a366-470d9b1e5924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:31.278304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa828514-fa2b-4ea2-a366-470d9b1e5924 admin admin] PATH_INFO: `/v3/projects/ba3c405747344888834492fb9317a25a/users/361c66d592b84f0e9959b22f932cb246/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:31.293369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa828514-fa2b-4ea2-a366-470d9b1e5924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba3c405747344888834492fb9317a25a, user_id=361c66d592b84f0e9959b22f932cb246, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:31.296194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa828514-fa2b-4ea2-a366-470d9b1e5924 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:31.486541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1094/2179] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:31 2022] PUT /identity/v3/projects/ba3c405747344888834492fb9317a25a/users/361c66d592b84f0e9959b22f932cb246/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:31.497395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42276a57-f82a-46cd-b49f-c10d8488ddb7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:31.497682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42276a57-f82a-46cd-b49f-c10d8488ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:31.497961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42276a57-f82a-46cd-b49f-c10d8488ddb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:31.529101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-42276a57-f82a-46cd-b49f-c10d8488ddb7 None None] MFA Rules not processed for user `361c66d592b84f0e9959b22f932cb246`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:31.530526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-42276a57-f82a-46cd-b49f-c10d8488ddb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:31.604918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1086/2180] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:31.623025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa828514-fa2b-4ea2-a366-470d9b1e5924 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:31.624877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fa828514-fa2b-4ea2-a366-470d9b1e5924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:31.687179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa828514-fa2b-4ea2-a366-470d9b1e5924 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:31.691289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141261c-8bc4-4b82-a65d-4d36913884bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:31.691977 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141261c-8bc4-4b82-a65d-4d36913884bc service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:31.692249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141261c-8bc4-4b82-a65d-4d36913884bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:31.692514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141261c-8bc4-4b82-a65d-4d36913884bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:31.704934 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141261c-8bc4-4b82-a65d-4d36913884bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:31.705053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141261c-8bc4-4b82-a65d-4d36913884bc service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:31.720130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1095/2181] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:31.754602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42276a57-f82a-46cd-b49f-c10d8488ddb7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:31.868744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42276a57-f82a-46cd-b49f-c10d8488ddb7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:31.875128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:31.883093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:31.883093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:31.883093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] PATH_INFO: `/v3/users/361c66d592b84f0e9959b22f932cb246` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:31.883093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=361c66d592b84f0e9959b22f932cb246)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:31.883093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:32.165407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '361c66d592b84f0e9959b22f932cb246'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:32.184434 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '361c66d592b84f0e9959b22f932cb246'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:32.193208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '361c66d592b84f0e9959b22f932cb246'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:32.194260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '361c66d592b84f0e9959b22f932cb246'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:32.194978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '361c66d592b84f0e9959b22f932cb246'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:32.306952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1087/2182] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:31 2022] DELETE /identity/v3/users/361c66d592b84f0e9959b22f932cb246 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:32.310359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9c69-fbf9-4231-8ec1-91d10679bbf6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:32.310775 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9c69-fbf9-4231-8ec1-91d10679bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:32.310921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c9c69-fbf9-4231-8ec1-91d10679bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:32.330963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-aa3c9c69-fbf9-4231-8ec1-91d10679bbf6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:32.332575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aa3c9c69-fbf9-4231-8ec1-91d10679bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:32.408796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1096/2183] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:32.421808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:32.422990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:32.492837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbee7cf-09c2-449e-b6eb-1c18bf5fb2af admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:32.498120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9e881c-a953-4fd9-956b-c4e910c16095 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:32.498120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e881c-a953-4fd9-956b-c4e910c16095 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:32.498120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e881c-a953-4fd9-956b-c4e910c16095 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:32.498120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9e881c-a953-4fd9-956b-c4e910c16095 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:32.508616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e881c-a953-4fd9-956b-c4e910c16095 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:32.510025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9e881c-a953-4fd9-956b-c4e910c16095 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:32.520503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1088/2184] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:32.567091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:33.091112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:33.138044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9c69-fbf9-4231-8ec1-91d10679bbf6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:33.139335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aa3c9c69-fbf9-4231-8ec1-91d10679bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:33.165003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c9c69-fbf9-4231-8ec1-91d10679bbf6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:33.204012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:33.205017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:33.205332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:33.222197 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] PATH_INFO: `/v3/projects/ba3c405747344888834492fb9317a25a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:33.222197 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba3c405747344888834492fb9317a25a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:33.222197 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:33.404599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba3c405747344888834492fb9317a25a', 'request_id': 'req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:33.410698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba3c405747344888834492fb9317a25a', 'request_id': 'req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:33.502718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba3c405747344888834492fb9317a25a', 'request_id': 'req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:33.516839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] The token cache is being invalidate because project ba3c405747344888834492fb9317a25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:33.517131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:33.517787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c48157c0-a1e8-4e9c-a60c-c3f492caa4d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:33.519467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1097/2185] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:33 2022] DELETE /identity/v3/projects/ba3c405747344888834492fb9317a25a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:33.524504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d1b6c-2692-40a1-9282-991f1b270edd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:33.525032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d1b6c-2692-40a1-9282-991f1b270edd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:33.525032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5d1b6c-2692-40a1-9282-991f1b270edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:33.544837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cd5d1b6c-2692-40a1-9282-991f1b270edd None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:33.546717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cd5d1b6c-2692-40a1-9282-991f1b270edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:33.627671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1089/2186] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:33.636834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d966532-80ce-4f2e-b1cc-c20f084fd6da None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:33.637359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d966532-80ce-4f2e-b1cc-c20f084fd6da None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:33.637805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d966532-80ce-4f2e-b1cc-c20f084fd6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:33.660357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-9d966532-80ce-4f2e-b1cc-c20f084fd6da None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:33.661645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9d966532-80ce-4f2e-b1cc-c20f084fd6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:33.680779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1098/2187] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:33.686144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d1b6c-2692-40a1-9282-991f1b270edd None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:33.697911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5d1b6c-2692-40a1-9282-991f1b270edd None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:33.705480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288dea8-5e4b-44ee-8fdd-4d44c391335a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:33.706363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288dea8-5e4b-44ee-8fdd-4d44c391335a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:33.706644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288dea8-5e4b-44ee-8fdd-4d44c391335a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:33.706945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0288dea8-5e4b-44ee-8fdd-4d44c391335a admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:33.707687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288dea8-5e4b-44ee-8fdd-4d44c391335a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:33.708162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288dea8-5e4b-44ee-8fdd-4d44c391335a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:33.710572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0288dea8-5e4b-44ee-8fdd-4d44c391335a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:33.723082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1090/2188] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:33.727570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d966532-80ce-4f2e-b1cc-c20f084fd6da None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:33.737799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d966532-80ce-4f2e-b1cc-c20f084fd6da None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:33.742509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f737d-a951-4733-9055-52602c5aa299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:33.743154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f737d-a951-4733-9055-52602c5aa299 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:33.743447 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f737d-a951-4733-9055-52602c5aa299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:33.743730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f737d-a951-4733-9055-52602c5aa299 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:33.747799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f737d-a951-4733-9055-52602c5aa299 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:33.747799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f737d-a951-4733-9055-52602c5aa299 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:33.844768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1099/2189] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:33 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:33.849114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288dea8-5e4b-44ee-8fdd-4d44c391335a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:33.859869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0288dea8-5e4b-44ee-8fdd-4d44c391335a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:33.924556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a101d-c7ca-4aba-aa5d-accedbc78ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:33.925457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a101d-c7ca-4aba-aa5d-accedbc78ee3 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:33.926675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a101d-c7ca-4aba-aa5d-accedbc78ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:33.927060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a101d-c7ca-4aba-aa5d-accedbc78ee3 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:33.928069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a101d-c7ca-4aba-aa5d-accedbc78ee3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:33.930375 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a101d-c7ca-4aba-aa5d-accedbc78ee3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:34.051137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1091/2190] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:33 2022] POST /identity/v3/users => generated 291 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:34.052986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f737d-a951-4733-9055-52602c5aa299 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:34.063482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f737d-a951-4733-9055-52602c5aa299 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:34.068936 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622047e7-da2f-4800-a53c-780ee42f884f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:34.069602 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622047e7-da2f-4800-a53c-780ee42f884f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:34.069882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622047e7-da2f-4800-a53c-780ee42f884f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:34.070158 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622047e7-da2f-4800-a53c-780ee42f884f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:34.070903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622047e7-da2f-4800-a53c-780ee42f884f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:34.072833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622047e7-da2f-4800-a53c-780ee42f884f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:34.083786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1100/2191] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:11:34.087810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a101d-c7ca-4aba-aa5d-accedbc78ee3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:34.103572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a101d-c7ca-4aba-aa5d-accedbc78ee3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:34.112258 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54883f8-8ffc-4d95-8c32-cd98a144dc76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:34.113010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54883f8-8ffc-4d95-8c32-cd98a144dc76 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:34.113872 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54883f8-8ffc-4d95-8c32-cd98a144dc76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:34.114115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54883f8-8ffc-4d95-8c32-cd98a144dc76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:34.114775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54883f8-8ffc-4d95-8c32-cd98a144dc76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:34.115297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:34.116552 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54883f8-8ffc-4d95-8c32-cd98a144dc76 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:34.128269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1092/2192] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:11:34.131706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622047e7-da2f-4800-a53c-780ee42f884f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:34.142473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622047e7-da2f-4800-a53c-780ee42f884f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:34.147195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6786d6-ebc8-4e55-8546-6b019da1a15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:34.148403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6786d6-ebc8-4e55-8546-6b019da1a15d admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:34.148687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6786d6-ebc8-4e55-8546-6b019da1a15d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:34.148959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6786d6-ebc8-4e55-8546-6b019da1a15d admin admin] PATH_INFO: `/v3/projects/8ab5175815f046f78309ea93f9100592/users/7b2f04953c114350bed092cbc2cdf3ec/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:34.182066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6786d6-ebc8-4e55-8546-6b019da1a15d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ab5175815f046f78309ea93f9100592, user_id=7b2f04953c114350bed092cbc2cdf3ec, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:34.185281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6786d6-ebc8-4e55-8546-6b019da1a15d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:34.285311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1101/2193] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:34 2022] PUT /identity/v3/projects/8ab5175815f046f78309ea93f9100592/users/7b2f04953c114350bed092cbc2cdf3ec/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:34.295704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc7338-8eb4-48c9-9032-9ea29457ef63 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:34.296141 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc7338-8eb4-48c9-9032-9ea29457ef63 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:34.296493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc7338-8eb4-48c9-9032-9ea29457ef63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:34.335585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cbcc7338-8eb4-48c9-9032-9ea29457ef63 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:34.338669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cbcc7338-8eb4-48c9-9032-9ea29457ef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:34.480383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1093/2194] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:34.491417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6786d6-ebc8-4e55-8546-6b019da1a15d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:34.494128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bb6786d6-ebc8-4e55-8546-6b019da1a15d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:34.601723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6786d6-ebc8-4e55-8546-6b019da1a15d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:34.617742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b553d-3526-48a4-b158-65c90e80e4f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:34.618582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b553d-3526-48a4-b158-65c90e80e4f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:34.619093 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b553d-3526-48a4-b158-65c90e80e4f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:34.619378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b553d-3526-48a4-b158-65c90e80e4f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:34.643243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b553d-3526-48a4-b158-65c90e80e4f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:34.645022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b553d-3526-48a4-b158-65c90e80e4f9 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:34.655626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1102/2195] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:34.737525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc7338-8eb4-48c9-9032-9ea29457ef63 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:34.740227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cbcc7338-8eb4-48c9-9032-9ea29457ef63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:34.758586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc7338-8eb4-48c9-9032-9ea29457ef63 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:34.768210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:34.769334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:34.769769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:34.770112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] PATH_INFO: `/v3/users/b5ec53ef3beb428f8b5b4c855b107dc7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:34.771494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5ec53ef3beb428f8b5b4c855b107dc7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:34.779450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:35.198729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5ec53ef3beb428f8b5b4c855b107dc7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:35.212257 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5ec53ef3beb428f8b5b4c855b107dc7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:35.221341 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5ec53ef3beb428f8b5b4c855b107dc7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:35.222110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5ec53ef3beb428f8b5b4c855b107dc7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:35.222775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5ec53ef3beb428f8b5b4c855b107dc7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:35.392323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1094/2196] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:34 2022] DELETE /identity/v3/users/b5ec53ef3beb428f8b5b4c855b107dc7 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:35.396665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b392357-5cab-49b4-b7a4-9eba642063c7 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:35.396953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b392357-5cab-49b4-b7a4-9eba642063c7 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:35.397232 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b392357-5cab-49b4-b7a4-9eba642063c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:35.416937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7b392357-5cab-49b4-b7a4-9eba642063c7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:35.418472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7b392357-5cab-49b4-b7a4-9eba642063c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:35.500078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1103/2197] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:35.508555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:35.510472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:35.595748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c32dc82-e94a-4fbb-bbb9-c59508fcfb0a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:35.599598 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb083e2-4963-46ae-94cb-85eed512fbc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:35.600406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb083e2-4963-46ae-94cb-85eed512fbc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:35.600839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb083e2-4963-46ae-94cb-85eed512fbc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:35.601165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb083e2-4963-46ae-94cb-85eed512fbc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:35.612661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb083e2-4963-46ae-94cb-85eed512fbc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:35.614382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb083e2-4963-46ae-94cb-85eed512fbc1 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:35.626176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1095/2198] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:35.740042 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:35.994543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:36.305051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b392357-5cab-49b4-b7a4-9eba642063c7 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:36.307749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7b392357-5cab-49b4-b7a4-9eba642063c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:36.345760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b392357-5cab-49b4-b7a4-9eba642063c7 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:36.351697 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:36.352751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:36.353062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:36.353368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] PATH_INFO: `/v3/projects/ce5fcdf7d3054622b208722b34ca4327` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:36.354771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce5fcdf7d3054622b208722b34ca4327)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:36.357677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:36.542568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce5fcdf7d3054622b208722b34ca4327', 'request_id': 'req-6816d359-1881-4b00-b2ec-6506d950fae5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:36.562323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce5fcdf7d3054622b208722b34ca4327', 'request_id': 'req-6816d359-1881-4b00-b2ec-6506d950fae5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:36.635411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce5fcdf7d3054622b208722b34ca4327', 'request_id': 'req-6816d359-1881-4b00-b2ec-6506d950fae5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:36.656698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] The token cache is being invalidate because project ce5fcdf7d3054622b208722b34ca4327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:36.657339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:36.658389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6816d359-1881-4b00-b2ec-6506d950fae5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:36.663995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1104/2199] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:36 2022] DELETE /identity/v3/projects/ce5fcdf7d3054622b208722b34ca4327 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:36.664859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb083e2-4963-46ae-94cb-85eed512fbc1 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:36.681837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb083e2-4963-46ae-94cb-85eed512fbc1 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:36.833626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:36.833626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:36.835621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:36.836250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] PATH_INFO: `/v3/users/5aabff0cded040e5977c5e47a458e546` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:36.837976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aabff0cded040e5977c5e47a458e546)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:36.841103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:37.182250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aabff0cded040e5977c5e47a458e546'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:37.208404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aabff0cded040e5977c5e47a458e546'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:37.217378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aabff0cded040e5977c5e47a458e546'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:37.218404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aabff0cded040e5977c5e47a458e546'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:37.219200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aabff0cded040e5977c5e47a458e546'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:37.367784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1096/2200] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:36 2022] DELETE /identity/v3/users/5aabff0cded040e5977c5e47a458e546 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:37.538762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558670aa-fccd-4e4c-b905-400725e712e5 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:37.539434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558670aa-fccd-4e4c-b905-400725e712e5 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:37.539525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558670aa-fccd-4e4c-b905-400725e712e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:37.580395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-558670aa-fccd-4e4c-b905-400725e712e5 None None] MFA Rules not processed for user `7b2f04953c114350bed092cbc2cdf3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:37.582505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-558670aa-fccd-4e4c-b905-400725e712e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:37.668950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1105/2201] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:37.682656 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:37.685759 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:37.761334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0559eb91-ea2c-4bad-9c2d-6211c03195c6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:37.764451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e36b81-fc4a-4fa1-8a2f-81bdfa0f54e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:37.765750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e36b81-fc4a-4fa1-8a2f-81bdfa0f54e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:37.766038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e36b81-fc4a-4fa1-8a2f-81bdfa0f54e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:37.766315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e36b81-fc4a-4fa1-8a2f-81bdfa0f54e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:37.775898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e36b81-fc4a-4fa1-8a2f-81bdfa0f54e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:37.777423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e36b81-fc4a-4fa1-8a2f-81bdfa0f54e1 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:37.789642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1097/2202] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:38.155555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558670aa-fccd-4e4c-b905-400725e712e5 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:38.158145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-558670aa-fccd-4e4c-b905-400725e712e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:38.237415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558670aa-fccd-4e4c-b905-400725e712e5 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:38.243686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:38.244597 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:38.244876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:38.245146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] PATH_INFO: `/v3/projects/403a7ecb31a84e92bc8457ab72a9ba70` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:38.247054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=403a7ecb31a84e92bc8457ab72a9ba70)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:38.249100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:38.350235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:38.440038 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403a7ecb31a84e92bc8457ab72a9ba70', 'request_id': 'req-74246712-2934-4752-b348-4053a2fd6dbd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:38.455040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403a7ecb31a84e92bc8457ab72a9ba70', 'request_id': 'req-74246712-2934-4752-b348-4053a2fd6dbd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:38.582275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403a7ecb31a84e92bc8457ab72a9ba70', 'request_id': 'req-74246712-2934-4752-b348-4053a2fd6dbd'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:38.611236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] The token cache is being invalidate because project 403a7ecb31a84e92bc8457ab72a9ba70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:38.612752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:38.621060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-74246712-2934-4752-b348-4053a2fd6dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:38.621060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1106/2203] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:38 2022] DELETE /identity/v3/projects/403a7ecb31a84e92bc8457ab72a9ba70 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:38.624584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368ed34-77e5-4ee6-9faa-710efcb386ea None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:38.624926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368ed34-77e5-4ee6-9faa-710efcb386ea None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:38.625209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368ed34-77e5-4ee6-9faa-710efcb386ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:38.655351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1368ed34-77e5-4ee6-9faa-710efcb386ea None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:38.656651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1368ed34-77e5-4ee6-9faa-710efcb386ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:38.734793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1098/2204] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:38.748265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0f84a-f0ab-4e49-b672-4654e936ecf6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:38.748750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0f84a-f0ab-4e49-b672-4654e936ecf6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:38.749130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd0f84a-f0ab-4e49-b672-4654e936ecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:38.772151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-abd0f84a-f0ab-4e49-b672-4654e936ecf6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:38.774438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-abd0f84a-f0ab-4e49-b672-4654e936ecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:38.786163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1107/2205] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:38.790562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368ed34-77e5-4ee6-9faa-710efcb386ea None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:38.802344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368ed34-77e5-4ee6-9faa-710efcb386ea None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:38.809006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835e1e7-ee42-417c-a588-80043a890ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:38.809484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835e1e7-ee42-417c-a588-80043a890ad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:38.810138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835e1e7-ee42-417c-a588-80043a890ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:38.810441 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0835e1e7-ee42-417c-a588-80043a890ad6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:38.811777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835e1e7-ee42-417c-a588-80043a890ad6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:38.812113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835e1e7-ee42-417c-a588-80043a890ad6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:38.815260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0835e1e7-ee42-417c-a588-80043a890ad6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:38.839516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1099/2206] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:11:38.847078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0f84a-f0ab-4e49-b672-4654e936ecf6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:38.861069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd0f84a-f0ab-4e49-b672-4654e936ecf6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:38.878318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773cf96-86fb-4e0d-afff-6baea4d0f925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:38.879007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773cf96-86fb-4e0d-afff-6baea4d0f925 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:38.879308 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773cf96-86fb-4e0d-afff-6baea4d0f925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:38.879602 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773cf96-86fb-4e0d-afff-6baea4d0f925 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:38.880341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773cf96-86fb-4e0d-afff-6baea4d0f925 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:38.882443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773cf96-86fb-4e0d-afff-6baea4d0f925 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:39.031875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1108/2207] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:38 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:39.035724 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835e1e7-ee42-417c-a588-80043a890ad6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:39.054135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0835e1e7-ee42-417c-a588-80043a890ad6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:39.148209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161e228-22ee-4806-bf35-f02df4de916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:39.149191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161e228-22ee-4806-bf35-f02df4de916c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:39.149628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161e228-22ee-4806-bf35-f02df4de916c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:39.150055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161e228-22ee-4806-bf35-f02df4de916c admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:39.151050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161e228-22ee-4806-bf35-f02df4de916c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:39.153499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161e228-22ee-4806-bf35-f02df4de916c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:39.291468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1100/2208] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:39 2022] POST /identity/v3/users => generated 289 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:39.292352 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773cf96-86fb-4e0d-afff-6baea4d0f925 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:39.304426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773cf96-86fb-4e0d-afff-6baea4d0f925 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:39.310793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b02bec-b2ce-4fc7-b1fa-e44b2a713c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:39.311595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02bec-b2ce-4fc7-b1fa-e44b2a713c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:39.312090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02bec-b2ce-4fc7-b1fa-e44b2a713c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:39.312392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b02bec-b2ce-4fc7-b1fa-e44b2a713c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:39.313180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02bec-b2ce-4fc7-b1fa-e44b2a713c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:39.315011 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b02bec-b2ce-4fc7-b1fa-e44b2a713c49 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:39.328230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1109/2209] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:11:39.332091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161e228-22ee-4806-bf35-f02df4de916c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:39.343435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161e228-22ee-4806-bf35-f02df4de916c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:39.352603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1f63b-7583-431f-9406-b7c8d95a68af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:39.352603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f63b-7583-431f-9406-b7c8d95a68af admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:39.352603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f63b-7583-431f-9406-b7c8d95a68af admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:39.352603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1f63b-7583-431f-9406-b7c8d95a68af admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:39.353476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1f63b-7583-431f-9406-b7c8d95a68af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:39.353476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1f63b-7583-431f-9406-b7c8d95a68af admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:39.364535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1101/2210] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:39.370915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b02bec-b2ce-4fc7-b1fa-e44b2a713c49 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:39.383704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b02bec-b2ce-4fc7-b1fa-e44b2a713c49 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:39.389639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c64fcf-4937-454e-b61d-d6b44ca042b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:39.391086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c64fcf-4937-454e-b61d-d6b44ca042b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:39.400434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c64fcf-4937-454e-b61d-d6b44ca042b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:39.400434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c64fcf-4937-454e-b61d-d6b44ca042b1 admin admin] PATH_INFO: `/v3/projects/5da27262ea1b44d180a2715c029aee04/users/7c026ae3f025476ab6a4beeffcbfa131/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:39.411229 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c64fcf-4937-454e-b61d-d6b44ca042b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da27262ea1b44d180a2715c029aee04, user_id=7c026ae3f025476ab6a4beeffcbfa131, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:39.414444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c64fcf-4937-454e-b61d-d6b44ca042b1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:39.516925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1110/2211] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:39 2022] PUT /identity/v3/projects/5da27262ea1b44d180a2715c029aee04/users/7c026ae3f025476ab6a4beeffcbfa131/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:39.530453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816b94a-2686-408d-af03-dd159bf41fb6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:39.530895 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816b94a-2686-408d-af03-dd159bf41fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:39.531240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d816b94a-2686-408d-af03-dd159bf41fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:39.569372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d816b94a-2686-408d-af03-dd159bf41fb6 None None] MFA Rules not processed for user `7c026ae3f025476ab6a4beeffcbfa131`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:39.571074 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d816b94a-2686-408d-af03-dd159bf41fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:39.663043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1102/2212] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:39.668654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c64fcf-4937-454e-b61d-d6b44ca042b1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:39.761624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c64fcf-4937-454e-b61d-d6b44ca042b1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:39.769373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f12fd2b-88aa-4c75-b18b-b75db78091ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:39.770790 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12fd2b-88aa-4c75-b18b-b75db78091ad admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:39.771150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12fd2b-88aa-4c75-b18b-b75db78091ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:39.771553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f12fd2b-88aa-4c75-b18b-b75db78091ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:39.772408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12fd2b-88aa-4c75-b18b-b75db78091ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:39.774399 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f12fd2b-88aa-4c75-b18b-b75db78091ad admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:39.914368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1111/2213] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:39 2022] POST /identity/v3/projects => generated 375 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:39.919210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816b94a-2686-408d-af03-dd159bf41fb6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:39.932959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d816b94a-2686-408d-af03-dd159bf41fb6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:39.992187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6fbbb-c7f4-4d3a-8889-fbe870fbf910 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:39.992499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6fbbb-c7f4-4d3a-8889-fbe870fbf910 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:39.992734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de6fbbb-c7f4-4d3a-8889-fbe870fbf910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:40.014312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2de6fbbb-c7f4-4d3a-8889-fbe870fbf910 None None] MFA Rules not processed for user `7b2f04953c114350bed092cbc2cdf3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:40.016345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2de6fbbb-c7f4-4d3a-8889-fbe870fbf910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:40.039996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19656c11-e8d7-44af-9469-cb4df025d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:40.039996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656c11-e8d7-44af-9469-cb4df025d29b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:40.039996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656c11-e8d7-44af-9469-cb4df025d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:40.039996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19656c11-e8d7-44af-9469-cb4df025d29b admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:40.040670 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19656c11-e8d7-44af-9469-cb4df025d29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:40.041499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19656c11-e8d7-44af-9469-cb4df025d29b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:40.102654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1112/2214] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:40.193261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1103/2215] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:39 2022] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:40.197048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6fbbb-c7f4-4d3a-8889-fbe870fbf910 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:40.210954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de6fbbb-c7f4-4d3a-8889-fbe870fbf910 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:40.233143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d498e7-85a2-4783-b366-9dfd543b2a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:40.236261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d498e7-85a2-4783-b366-9dfd543b2a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:40.236556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d498e7-85a2-4783-b366-9dfd543b2a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:40.236837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d498e7-85a2-4783-b366-9dfd543b2a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:40.237594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d498e7-85a2-4783-b366-9dfd543b2a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:40.239251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d498e7-85a2-4783-b366-9dfd543b2a08 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:40.254083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1113/2216] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:11:40.258180 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19656c11-e8d7-44af-9469-cb4df025d29b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:40.279392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19656c11-e8d7-44af-9469-cb4df025d29b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:40.291791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a3021-d137-45d2-ade3-913b8caceb67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:40.293185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3021-d137-45d2-ade3-913b8caceb67 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:40.295753 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3021-d137-45d2-ade3-913b8caceb67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:40.296244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a3021-d137-45d2-ade3-913b8caceb67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:40.300181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a3021-d137-45d2-ade3-913b8caceb67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:40.303323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a3021-d137-45d2-ade3-913b8caceb67 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:40.322558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1104/2217] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:40.326851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d498e7-85a2-4783-b366-9dfd543b2a08 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:40.337530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:40.350232 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d498e7-85a2-4783-b366-9dfd543b2a08 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:40.367671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e337c3-c5fd-4ee8-883e-d435cccefe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:40.369961 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e337c3-c5fd-4ee8-883e-d435cccefe49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:40.370313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e337c3-c5fd-4ee8-883e-d435cccefe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:40.370709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e337c3-c5fd-4ee8-883e-d435cccefe49 admin admin] PATH_INFO: `/v3/projects/78fb36afb23841f1904912534d505939/users/5efd0f071ad248c38d803381e2ca1134/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:40.428845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e337c3-c5fd-4ee8-883e-d435cccefe49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78fb36afb23841f1904912534d505939, user_id=5efd0f071ad248c38d803381e2ca1134, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:40.432571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e337c3-c5fd-4ee8-883e-d435cccefe49 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:40.550028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1114/2218] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:40 2022] PUT /identity/v3/projects/78fb36afb23841f1904912534d505939/users/5efd0f071ad248c38d803381e2ca1134/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:40.561381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0ba41-247e-4528-abc1-64bf8681310c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:40.562596 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0ba41-247e-4528-abc1-64bf8681310c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:40.563073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0ba41-247e-4528-abc1-64bf8681310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:40.611216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b1c0ba41-247e-4528-abc1-64bf8681310c None None] MFA Rules not processed for user `5efd0f071ad248c38d803381e2ca1134`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:40.616084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b1c0ba41-247e-4528-abc1-64bf8681310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:40.734103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1105/2219] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:40.739018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e337c3-c5fd-4ee8-883e-d435cccefe49 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:40.825363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e337c3-c5fd-4ee8-883e-d435cccefe49 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:40.833438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54845-998b-4e3b-9e32-88257c9e7c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:40.833438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54845-998b-4e3b-9e32-88257c9e7c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:40.834081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54845-998b-4e3b-9e32-88257c9e7c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:40.834374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a54845-998b-4e3b-9e32-88257c9e7c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:40.835112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a54845-998b-4e3b-9e32-88257c9e7c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:40.838191 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a54845-998b-4e3b-9e32-88257c9e7c89 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:40.995197 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1115/2220] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:40 2022] POST /identity/v3/projects => generated 377 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:40.997055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0ba41-247e-4528-abc1-64bf8681310c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:41.010564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0ba41-247e-4528-abc1-64bf8681310c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:41.071816 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454955b3-b0b9-49d0-8fa4-62b8f7d50bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:41.072578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454955b3-b0b9-49d0-8fa4-62b8f7d50bce admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:41.072862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454955b3-b0b9-49d0-8fa4-62b8f7d50bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:41.073186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454955b3-b0b9-49d0-8fa4-62b8f7d50bce admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:41.073953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454955b3-b0b9-49d0-8fa4-62b8f7d50bce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:41.076623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454955b3-b0b9-49d0-8fa4-62b8f7d50bce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:41.181558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1106/2221] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:40 2022] POST /identity/v3/users => generated 295 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:41.182756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54845-998b-4e3b-9e32-88257c9e7c89 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:41.193501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a54845-998b-4e3b-9e32-88257c9e7c89 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:41.198297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f8b55-2b92-4d12-bd9a-c76c51b73f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:41.199610 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f8b55-2b92-4d12-bd9a-c76c51b73f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:41.200008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f8b55-2b92-4d12-bd9a-c76c51b73f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:41.200355 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f8b55-2b92-4d12-bd9a-c76c51b73f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:41.201159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f8b55-2b92-4d12-bd9a-c76c51b73f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:41.202827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f8b55-2b92-4d12-bd9a-c76c51b73f97 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:41.214114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1116/2222] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:11:41.220125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454955b3-b0b9-49d0-8fa4-62b8f7d50bce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:41.230533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454955b3-b0b9-49d0-8fa4-62b8f7d50bce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:41.242721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6a92e-4ee0-41d3-bdc9-052f9ad53993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:41.244634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6a92e-4ee0-41d3-bdc9-052f9ad53993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:41.244634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6a92e-4ee0-41d3-bdc9-052f9ad53993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:41.244634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c6a92e-4ee0-41d3-bdc9-052f9ad53993 admin admin] PATH_INFO: `/v3/projects/7e48786a506743b5adeab28f6e38cdbb/users/29531be9d8ee41d8a994767c80ec7e87/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:41.266016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6a92e-4ee0-41d3-bdc9-052f9ad53993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e48786a506743b5adeab28f6e38cdbb, user_id=29531be9d8ee41d8a994767c80ec7e87, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:41.270289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c6a92e-4ee0-41d3-bdc9-052f9ad53993 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:41.305657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:41.401064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1107/2223] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:41 2022] PUT /identity/v3/projects/7e48786a506743b5adeab28f6e38cdbb/users/29531be9d8ee41d8a994767c80ec7e87/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:41.405540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f8b55-2b92-4d12-bd9a-c76c51b73f97 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:41.416956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f8b55-2b92-4d12-bd9a-c76c51b73f97 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:41.493466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e807b397-880a-4c5d-9fb7-5a7850ee5b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:41.493466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807b397-880a-4c5d-9fb7-5a7850ee5b5d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:41.493466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807b397-880a-4c5d-9fb7-5a7850ee5b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:41.493466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e807b397-880a-4c5d-9fb7-5a7850ee5b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:41.493898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807b397-880a-4c5d-9fb7-5a7850ee5b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:41.493898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e807b397-880a-4c5d-9fb7-5a7850ee5b5d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:41.504001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1117/2224] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:11:41.508203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6a92e-4ee0-41d3-bdc9-052f9ad53993 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:41.519750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c6a92e-4ee0-41d3-bdc9-052f9ad53993 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:41.524475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad9cb0-9f80-40a9-a87e-bea3f3e8c7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:41.525361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad9cb0-9f80-40a9-a87e-bea3f3e8c7dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:41.525673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad9cb0-9f80-40a9-a87e-bea3f3e8c7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:41.525948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad9cb0-9f80-40a9-a87e-bea3f3e8c7dd admin admin] PATH_INFO: `/v3/projects/7e48786a506743b5adeab28f6e38cdbb/users/29531be9d8ee41d8a994767c80ec7e87/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:41.528177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad9cb0-9f80-40a9-a87e-bea3f3e8c7dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e48786a506743b5adeab28f6e38cdbb, user_id=29531be9d8ee41d8a994767c80ec7e87, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:41.530877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ad9cb0-9f80-40a9-a87e-bea3f3e8c7dd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:41.542438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1108/2225] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:41 2022] PUT /identity/v3/projects/7e48786a506743b5adeab28f6e38cdbb/users/29531be9d8ee41d8a994767c80ec7e87/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:41.561137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fd6ac-7135-4eef-98cb-33118b687216 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:41.561429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fd6ac-7135-4eef-98cb-33118b687216 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:41.561713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877fd6ac-7135-4eef-98cb-33118b687216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:41.601292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-877fd6ac-7135-4eef-98cb-33118b687216 None None] MFA Rules not processed for user `29531be9d8ee41d8a994767c80ec7e87`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:41.602818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-877fd6ac-7135-4eef-98cb-33118b687216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:41.744123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1118/2226] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:41.756507 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad9cb0-9f80-40a9-a87e-bea3f3e8c7dd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:41.765051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-28ad9cb0-9f80-40a9-a87e-bea3f3e8c7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:41.859416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ad9cb0-9f80-40a9-a87e-bea3f3e8c7dd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:41.865578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f811-9949-4325-ad2a-df8a751785e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:41.866301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f811-9949-4325-ad2a-df8a751785e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:41.866635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f811-9949-4325-ad2a-df8a751785e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:41.866971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1614f811-9949-4325-ad2a-df8a751785e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:41.930811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614f811-9949-4325-ad2a-df8a751785e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:41.932409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1614f811-9949-4325-ad2a-df8a751785e5 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:41.956227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1109/2227] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:44.182758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fd6ac-7135-4eef-98cb-33118b687216 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:44.198146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877fd6ac-7135-4eef-98cb-33118b687216 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:44.216282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3231c45-5f60-4692-b57f-d9710253eb05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:44.221517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3231c45-5f60-4692-b57f-d9710253eb05 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:44.221517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3231c45-5f60-4692-b57f-d9710253eb05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:44.221517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3231c45-5f60-4692-b57f-d9710253eb05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:44.311170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3231c45-5f60-4692-b57f-d9710253eb05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:44.312674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3231c45-5f60-4692-b57f-d9710253eb05 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:44.323441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1119/2228] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:44 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:44.727050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:46.428192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:46.635387 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f811-9949-4325-ad2a-df8a751785e5 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:46.653834 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1614f811-9949-4325-ad2a-df8a751785e5 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:46.659726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82ee3-ebce-42d3-97b3-e80f30ff520a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:46.672061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82ee3-ebce-42d3-97b3-e80f30ff520a service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:46.672061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82ee3-ebce-42d3-97b3-e80f30ff520a service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:46.672061 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82ee3-ebce-42d3-97b3-e80f30ff520a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:46.677882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82ee3-ebce-42d3-97b3-e80f30ff520a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:46.680463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82ee3-ebce-42d3-97b3-e80f30ff520a service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:46.695911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1110/2229] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:49.092853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:49.657748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:50.469327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:51.881557 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:52.054140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3231c45-5f60-4692-b57f-d9710253eb05 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:52.145493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3231c45-5f60-4692-b57f-d9710253eb05 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:52.150746 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:52.151673 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:52.152533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:52.152787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] PATH_INFO: `/v3/users/7c026ae3f025476ab6a4beeffcbfa131` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:52.154337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c026ae3f025476ab6a4beeffcbfa131)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:52.156364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:52.435761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c026ae3f025476ab6a4beeffcbfa131'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:52.526548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c026ae3f025476ab6a4beeffcbfa131'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:52.535516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c026ae3f025476ab6a4beeffcbfa131'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:52.536487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c026ae3f025476ab6a4beeffcbfa131'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:52.552441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c026ae3f025476ab6a4beeffcbfa131'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:52.560939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1120/2230] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:52 2022] DELETE /identity/v3/users/7c026ae3f025476ab6a4beeffcbfa131 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:52.565705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14c27-21b3-4fc5-a291-bcb1e00f1e83 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:52.567907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14c27-21b3-4fc5-a291-bcb1e00f1e83 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:52.568465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb14c27-21b3-4fc5-a291-bcb1e00f1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:52.590444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-efb14c27-21b3-4fc5-a291-bcb1e00f1e83 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:52.591778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-efb14c27-21b3-4fc5-a291-bcb1e00f1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:52.693526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1111/2231] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:52.727075 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:52.728403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:52.801265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9145ac-8a94-4850-8343-6252de3a9ffe admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:52.807481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e7a01-6bfa-4e3b-a926-d0ae5bfe3452 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:52.808332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e7a01-6bfa-4e3b-a926-d0ae5bfe3452 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:52.808678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e7a01-6bfa-4e3b-a926-d0ae5bfe3452 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:52.809022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134e7a01-6bfa-4e3b-a926-d0ae5bfe3452 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:52.819801 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e7a01-6bfa-4e3b-a926-d0ae5bfe3452 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:52.821444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134e7a01-6bfa-4e3b-a926-d0ae5bfe3452 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:52.832718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1121/2232] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:53.358145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=79,keystone:DELETE=18,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:53.723650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb14c27-21b3-4fc5-a291-bcb1e00f1e83 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:53.725793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-efb14c27-21b3-4fc5-a291-bcb1e00f1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:53.752500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb14c27-21b3-4fc5-a291-bcb1e00f1e83 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:53.764008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:53.771467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:53.771808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:53.772288 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] PATH_INFO: `/v3/projects/5da27262ea1b44d180a2715c029aee04` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:53.778935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da27262ea1b44d180a2715c029aee04)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:53.778935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:53.987792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da27262ea1b44d180a2715c029aee04', 'request_id': 'req-83476958-c1f5-420f-8bbb-b2d3040ba611'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:53.997415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da27262ea1b44d180a2715c029aee04', 'request_id': 'req-83476958-c1f5-420f-8bbb-b2d3040ba611'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:54.142234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da27262ea1b44d180a2715c029aee04', 'request_id': 'req-83476958-c1f5-420f-8bbb-b2d3040ba611'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:54.154910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] The token cache is being invalidate because project 5da27262ea1b44d180a2715c029aee04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:54.155310 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:54.156079 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:54.157718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1112/2233] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:53 2022] DELETE /identity/v3/projects/5da27262ea1b44d180a2715c029aee04 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:54.162395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e7a01-6bfa-4e3b-a926-d0ae5bfe3452 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:54.173429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134e7a01-6bfa-4e3b-a926-d0ae5bfe3452 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:54.233134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:54.234722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:54.235154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:54.235436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] PATH_INFO: `/v3/users/5efd0f071ad248c38d803381e2ca1134` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:54.236744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5efd0f071ad248c38d803381e2ca1134)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:54.238715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:54.525417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5efd0f071ad248c38d803381e2ca1134'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:54.594953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5efd0f071ad248c38d803381e2ca1134'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:54.603761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5efd0f071ad248c38d803381e2ca1134'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:54.604623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5efd0f071ad248c38d803381e2ca1134'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:54.618885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5efd0f071ad248c38d803381e2ca1134'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:54.626381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1122/2234] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:54 2022] DELETE /identity/v3/users/5efd0f071ad248c38d803381e2ca1134 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:54.991763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:55.123533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:55.123533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:55.139335 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83476958-c1f5-420f-8bbb-b2d3040ba611 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:55.223304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:55.224311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:55.224495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:55.224771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] PATH_INFO: `/v3/projects/78fb36afb23841f1904912534d505939` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:55.225982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=78fb36afb23841f1904912534d505939)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:55.228082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:55.392880 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78fb36afb23841f1904912534d505939', 'request_id': 'req-8eb84080-6249-4c98-83ba-eee436c05e4d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:55.398942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78fb36afb23841f1904912534d505939', 'request_id': 'req-8eb84080-6249-4c98-83ba-eee436c05e4d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:55.490006 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78fb36afb23841f1904912534d505939', 'request_id': 'req-8eb84080-6249-4c98-83ba-eee436c05e4d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:55.502321 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] The token cache is being invalidate because project 78fb36afb23841f1904912534d505939 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:55.502734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:55.503467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8eb84080-6249-4c98-83ba-eee436c05e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:55.505127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1113/2235] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:55 2022] DELETE /identity/v3/projects/78fb36afb23841f1904912534d505939 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:55.512665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:55.515140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:55.541077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d15778-2f02-4c4e-a2ea-b9731bb57861 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:55.541362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d15778-2f02-4c4e-a2ea-b9731bb57861 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:55.541697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d15778-2f02-4c4e-a2ea-b9731bb57861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:55.544838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7e0fe5-b8ba-466e-b060-9edc1e27ed7f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:55.564538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-60d15778-2f02-4c4e-a2ea-b9731bb57861 None None] MFA Rules not processed for user `3437fb4f6caf4ba185cc10ce9f449353`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:55.565962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-60d15778-2f02-4c4e-a2ea-b9731bb57861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:55.621183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:55.622173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:55.622273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:55.624039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] PATH_INFO: `/v3/users/29531be9d8ee41d8a994767c80ec7e87` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:55.625765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29531be9d8ee41d8a994767c80ec7e87)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:55.628827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:55.659281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1114/2236] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:55.762585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:55.861894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29531be9d8ee41d8a994767c80ec7e87'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:55.989423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29531be9d8ee41d8a994767c80ec7e87'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:55.997002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29531be9d8ee41d8a994767c80ec7e87'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:55.997956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29531be9d8ee41d8a994767c80ec7e87'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:56.014965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-67e91612-882e-47a9-ac4f-62c03169b055 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29531be9d8ee41d8a994767c80ec7e87'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:56.022399 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1123/2237] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:11:55 2022] DELETE /identity/v3/users/29531be9d8ee41d8a994767c80ec7e87 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:56.499182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d15778-2f02-4c4e-a2ea-b9731bb57861 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:56.501406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-60d15778-2f02-4c4e-a2ea-b9731bb57861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:56.526977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d15778-2f02-4c4e-a2ea-b9731bb57861 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:56.619570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:56.620495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:56.620779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:56.621260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] PATH_INFO: `/v3/projects/7e48786a506743b5adeab28f6e38cdbb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:56.622970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e48786a506743b5adeab28f6e38cdbb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:56.625561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:56.796661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e48786a506743b5adeab28f6e38cdbb', 'request_id': 'req-625ff005-eeda-413a-9c64-f38d5c36dd50'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:56.801126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e48786a506743b5adeab28f6e38cdbb', 'request_id': 'req-625ff005-eeda-413a-9c64-f38d5c36dd50'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:56.913921 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e48786a506743b5adeab28f6e38cdbb', 'request_id': 'req-625ff005-eeda-413a-9c64-f38d5c36dd50'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:56.927008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] The token cache is being invalidate because project 7e48786a506743b5adeab28f6e38cdbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:11:56.927304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:56.927996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-625ff005-eeda-413a-9c64-f38d5c36dd50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:11:56.929638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1115/2238] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:11:56 2022] DELETE /identity/v3/projects/7e48786a506743b5adeab28f6e38cdbb => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:11:56.935337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6faa4-2914-49ca-9642-320dce899e22 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:56.935857 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6faa4-2914-49ca-9642-320dce899e22 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:56.935978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6faa4-2914-49ca-9642-320dce899e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:56.956146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-03f6faa4-2914-49ca-9642-320dce899e22 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:56.957270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-03f6faa4-2914-49ca-9642-320dce899e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:57.019717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1124/2239] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:57.028683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66ed8-0be2-4806-878f-af4146639c0c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.029209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66ed8-0be2-4806-878f-af4146639c0c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.029877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d66ed8-0be2-4806-878f-af4146639c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.047534 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f152a3-1004-4b39-8d07-5f8cfcba8318 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.047838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f152a3-1004-4b39-8d07-5f8cfcba8318 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.048143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f152a3-1004-4b39-8d07-5f8cfcba8318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.052169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-71d66ed8-0be2-4806-878f-af4146639c0c None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:57.053389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-71d66ed8-0be2-4806-878f-af4146639c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:57.063571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1116/2240] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:57.067810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66ed8-0be2-4806-878f-af4146639c0c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:57.069320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f1f152a3-1004-4b39-8d07-5f8cfcba8318 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:57.070654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f1f152a3-1004-4b39-8d07-5f8cfcba8318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:57.077932 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d66ed8-0be2-4806-878f-af4146639c0c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:57.082739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71e20-0e4c-4621-bcf2-58ec2fb87cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:57.083404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71e20-0e4c-4621-bcf2-58ec2fb87cc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.083715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71e20-0e4c-4621-bcf2-58ec2fb87cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.085618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d71e20-0e4c-4621-bcf2-58ec2fb87cc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.085618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71e20-0e4c-4621-bcf2-58ec2fb87cc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:11:57.085618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71e20-0e4c-4621-bcf2-58ec2fb87cc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:57.086866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d71e20-0e4c-4621-bcf2-58ec2fb87cc6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:57.101021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1117/2241] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:11:57.108809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71e20-0e4c-4621-bcf2-58ec2fb87cc6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:57.117494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d71e20-0e4c-4621-bcf2-58ec2fb87cc6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:57.123361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c4488-5638-4b49-b8eb-5c2baef2d2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:57.124244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4488-5638-4b49-b8eb-5c2baef2d2a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.124527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4488-5638-4b49-b8eb-5c2baef2d2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.124803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c4488-5638-4b49-b8eb-5c2baef2d2a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.125505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c4488-5638-4b49-b8eb-5c2baef2d2a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:57.127420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c4488-5638-4b49-b8eb-5c2baef2d2a0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:57.139128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1125/2242] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:11:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:11:57.182403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f152a3-1004-4b39-8d07-5f8cfcba8318 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:57.183846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f1f152a3-1004-4b39-8d07-5f8cfcba8318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:57.204331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1118/2243] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:11:57 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:11:57.208312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c4488-5638-4b49-b8eb-5c2baef2d2a0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:57.253250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:57.270134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f152a3-1004-4b39-8d07-5f8cfcba8318 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:57.278317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c4488-5638-4b49-b8eb-5c2baef2d2a0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:57.284215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c518588-4399-4674-a1b4-3a1b08247297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:57.284944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c518588-4399-4674-a1b4-3a1b08247297 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.285269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c518588-4399-4674-a1b4-3a1b08247297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.285554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c518588-4399-4674-a1b4-3a1b08247297 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.286267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c518588-4399-4674-a1b4-3a1b08247297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:57.289694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c518588-4399-4674-a1b4-3a1b08247297 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:57.339976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8f5c8-3c19-4628-b3c3-89daf600e5d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:57.340754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8f5c8-3c19-4628-b3c3-89daf600e5d7 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.341261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8f5c8-3c19-4628-b3c3-89daf600e5d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.341833 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e8f5c8-3c19-4628-b3c3-89daf600e5d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.374464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1119/2244] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:11:57 2022] POST /identity/v3/users => generated 291 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:11:57.379095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c518588-4399-4674-a1b4-3a1b08247297 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:57.391551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c518588-4399-4674-a1b4-3a1b08247297 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:57.396645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3854b-a9e0-404f-8e6b-e200a5637cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:57.397317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3854b-a9e0-404f-8e6b-e200a5637cca admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.397660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3854b-a9e0-404f-8e6b-e200a5637cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.398000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3854b-a9e0-404f-8e6b-e200a5637cca admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.398858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3854b-a9e0-404f-8e6b-e200a5637cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:57.400618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c3854b-a9e0-404f-8e6b-e200a5637cca admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:57.411591 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8f5c8-3c19-4628-b3c3-89daf600e5d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:57.412958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1120/2245] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:11:57.416562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e8f5c8-3c19-4628-b3c3-89daf600e5d7 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:57.417012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3854b-a9e0-404f-8e6b-e200a5637cca admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:57.426974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1126/2246] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:11:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 22:11:57.428262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c3854b-a9e0-404f-8e6b-e200a5637cca admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:57.433042 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135e01-b974-4211-b205-9fca8e6a8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:57.433700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135e01-b974-4211-b205-9fca8e6a8afa admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.438037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135e01-b974-4211-b205-9fca8e6a8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.438037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135e01-b974-4211-b205-9fca8e6a8afa admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.438037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135e01-b974-4211-b205-9fca8e6a8afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:57.438037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135e01-b974-4211-b205-9fca8e6a8afa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:57.448374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1121/2247] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:11:57.452824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8f5c8-3c19-4628-b3c3-89daf600e5d7 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:57.463629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e8f5c8-3c19-4628-b3c3-89daf600e5d7 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:57.469668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78659c42-f008-4e0e-9b21-e27ebae1aaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:57.470772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78659c42-f008-4e0e-9b21-e27ebae1aaac admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.472332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78659c42-f008-4e0e-9b21-e27ebae1aaac admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.472332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78659c42-f008-4e0e-9b21-e27ebae1aaac admin admin] PATH_INFO: `/v3/projects/b9b4d120eb414a098262ea4ef1da57de/users/0ecb875a44204a7ca515a62912323eb1/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.487900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78659c42-f008-4e0e-9b21-e27ebae1aaac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b4d120eb414a098262ea4ef1da57de, user_id=0ecb875a44204a7ca515a62912323eb1, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:57.490748 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78659c42-f008-4e0e-9b21-e27ebae1aaac admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:57.584849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1127/2248] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:11:57 2022] PUT /identity/v3/projects/b9b4d120eb414a098262ea4ef1da57de/users/0ecb875a44204a7ca515a62912323eb1/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:11:57.596075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c58606-ae0d-4d20-9118-4a88edf0abc2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.596572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c58606-ae0d-4d20-9118-4a88edf0abc2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.596651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c58606-ae0d-4d20-9118-4a88edf0abc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.627088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f8c58606-ae0d-4d20-9118-4a88edf0abc2 None None] MFA Rules not processed for user `0ecb875a44204a7ca515a62912323eb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:57.628602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f8c58606-ae0d-4d20-9118-4a88edf0abc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:57.710707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1122/2249] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:11:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:57.723223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78659c42-f008-4e0e-9b21-e27ebae1aaac admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:57.724943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-78659c42-f008-4e0e-9b21-e27ebae1aaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:57.787521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78659c42-f008-4e0e-9b21-e27ebae1aaac admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:57.791444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ed84-d0d0-4f1f-828b-73946b253906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:57.792129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ed84-d0d0-4f1f-828b-73946b253906 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:57.792417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ed84-d0d0-4f1f-828b-73946b253906 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:57.809545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106ed84-d0d0-4f1f-828b-73946b253906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:57.809545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106ed84-d0d0-4f1f-828b-73946b253906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:57.809545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106ed84-d0d0-4f1f-828b-73946b253906 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:57.813981 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1128/2250] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:11:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:11:57.853860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:58.586466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0aa2-551c-42f1-905d-b14d482c13b1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:58.586867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0aa2-551c-42f1-905d-b14d482c13b1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:58.587566 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a0aa2-551c-42f1-905d-b14d482c13b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:58.610668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c70a0aa2-551c-42f1-905d-b14d482c13b1 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:58.612099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c70a0aa2-551c-42f1-905d-b14d482c13b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:58.691935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1123/2251] 10.222.0.85 () {58 vars in 967 bytes} [Wed Jul 20 22:11:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:58.705948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ed84-d0d0-4f1f-828b-73946b253906 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:58.803862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106ed84-d0d0-4f1f-828b-73946b253906 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:58.810690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fc38c-0788-4abc-8764-d7fc5af54006 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:58.811686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc38c-0788-4abc-8764-d7fc5af54006 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:58.812006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc38c-0788-4abc-8764-d7fc5af54006 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:58.812285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fc38c-0788-4abc-8764-d7fc5af54006 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:58.821760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fc38c-0788-4abc-8764-d7fc5af54006 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:58.823365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fc38c-0788-4abc-8764-d7fc5af54006 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:58.832971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1129/2252] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:11:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:11:58.932831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:59.016890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:11:59.540491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92371b6c-c189-47c9-9d22-16cef11ac7c8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:59.540971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92371b6c-c189-47c9-9d22-16cef11ac7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:59.541249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92371b6c-c189-47c9-9d22-16cef11ac7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:59.560464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-92371b6c-c189-47c9-9d22-16cef11ac7c8 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:11:59.562078 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-92371b6c-c189-47c9-9d22-16cef11ac7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:11:59.573372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1124/2253] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:11:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:11:59.583053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fc38c-0788-4abc-8764-d7fc5af54006 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:11:59.601070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fc38c-0788-4abc-8764-d7fc5af54006 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:11:59.609208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc25dc-f0fd-40fb-879d-68f047e488e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:11:59.612161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc25dc-f0fd-40fb-879d-68f047e488e6 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:11:59.612660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc25dc-f0fd-40fb-879d-68f047e488e6 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:11:59.613128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bc25dc-f0fd-40fb-879d-68f047e488e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:11:59.627745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc25dc-f0fd-40fb-879d-68f047e488e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:11:59.630651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bc25dc-f0fd-40fb-879d-68f047e488e6 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:11:59.645618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1130/2254] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:12:00.458790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facea830-871a-469b-946a-c9bdbb40a6aa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:00.462293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facea830-871a-469b-946a-c9bdbb40a6aa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:00.462293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facea830-871a-469b-946a-c9bdbb40a6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:00.483015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-facea830-871a-469b-946a-c9bdbb40a6aa None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:00.484283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-facea830-871a-469b-946a-c9bdbb40a6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:00.493236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1125/2255] 10.222.0.85 () {58 vars in 967 bytes} [Wed Jul 20 22:12:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:00.506607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc25dc-f0fd-40fb-879d-68f047e488e6 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:00.534342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bc25dc-f0fd-40fb-879d-68f047e488e6 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:00.542423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1ad17d-698e-46fd-8d79-06dc18e28fde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:00.543218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad17d-698e-46fd-8d79-06dc18e28fde service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:00.543595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad17d-698e-46fd-8d79-06dc18e28fde service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:00.544587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1ad17d-698e-46fd-8d79-06dc18e28fde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:00.554327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad17d-698e-46fd-8d79-06dc18e28fde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:00.556249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1ad17d-698e-46fd-8d79-06dc18e28fde service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:00.565460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1131/2256] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:12:01.102027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facea830-871a-469b-946a-c9bdbb40a6aa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:01.208830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:01.208921 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facea830-871a-469b-946a-c9bdbb40a6aa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:01.213845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:01.214732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:01.216457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:01.216457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] PATH_INFO: `/v3/users/0ecb875a44204a7ca515a62912323eb1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:01.218668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ecb875a44204a7ca515a62912323eb1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:01.221081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:01.434448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ecb875a44204a7ca515a62912323eb1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:01.451245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ecb875a44204a7ca515a62912323eb1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:01.460478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ecb875a44204a7ca515a62912323eb1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:01.463299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ecb875a44204a7ca515a62912323eb1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:01.467243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ecb875a44204a7ca515a62912323eb1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:01.576590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1126/2257] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:12:01 2022] DELETE /identity/v3/users/0ecb875a44204a7ca515a62912323eb1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:12:01.578368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a41ab-f3db-4578-ad51-399a04ff9994 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:01.578879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a41ab-f3db-4578-ad51-399a04ff9994 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:01.579208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48a41ab-f3db-4578-ad51-399a04ff9994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:01.602217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-b48a41ab-f3db-4578-ad51-399a04ff9994 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:01.605070 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b48a41ab-f3db-4578-ad51-399a04ff9994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:01.681168 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1132/2258] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:12:01.691230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:01.693481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:01.758354 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85476e7a-979f-473a-81a9-98a11858676b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:01.767016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8df071-1a8c-441b-a623-468a77ddeca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:01.767928 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8df071-1a8c-441b-a623-468a77ddeca0 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:01.768252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8df071-1a8c-441b-a623-468a77ddeca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:01.768528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8df071-1a8c-441b-a623-468a77ddeca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:01.776977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:01.782918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8df071-1a8c-441b-a623-468a77ddeca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:01.784997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8df071-1a8c-441b-a623-468a77ddeca0 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:01.797199 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1127/2259] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:12:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:12:03.122313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a41ab-f3db-4578-ad51-399a04ff9994 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:03.124290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b48a41ab-f3db-4578-ad51-399a04ff9994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:03.149133 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48a41ab-f3db-4578-ad51-399a04ff9994 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:03.155085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:03.157055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:03.157489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:03.157931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] PATH_INFO: `/v3/projects/b9b4d120eb414a098262ea4ef1da57de` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:03.160318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b4d120eb414a098262ea4ef1da57de)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:03.163078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:03.334352 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b4d120eb414a098262ea4ef1da57de', 'request_id': 'req-96bc8f73-c7f8-41f9-875c-dc312ce2d104'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:03.345622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b4d120eb414a098262ea4ef1da57de', 'request_id': 'req-96bc8f73-c7f8-41f9-875c-dc312ce2d104'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:03.456496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b4d120eb414a098262ea4ef1da57de', 'request_id': 'req-96bc8f73-c7f8-41f9-875c-dc312ce2d104'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:03.459123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:03.472267 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] The token cache is being invalidate because project b9b4d120eb414a098262ea4ef1da57de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:12:03.473282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:03.474202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-96bc8f73-c7f8-41f9-875c-dc312ce2d104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:03.476148 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1133/2260] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:12:03 2022] DELETE /identity/v3/projects/b9b4d120eb414a098262ea4ef1da57de => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:12:03.481586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb25024-0836-430b-8164-b33e8e013b02 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:03.482732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb25024-0836-430b-8164-b33e8e013b02 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:03.482732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb25024-0836-430b-8164-b33e8e013b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:03.502399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fbb25024-0836-430b-8164-b33e8e013b02 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:03.503771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fbb25024-0836-430b-8164-b33e8e013b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:03.580025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1128/2261] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:03.588797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262a0a1-002b-4704-9a48-766b514a8db6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:03.589090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262a0a1-002b-4704-9a48-766b514a8db6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:03.589373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f262a0a1-002b-4704-9a48-766b514a8db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:03.608338 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f262a0a1-002b-4704-9a48-766b514a8db6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:03.609561 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f262a0a1-002b-4704-9a48-766b514a8db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:03.612381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:03.618600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1134/2262] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:03.623787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb25024-0836-430b-8164-b33e8e013b02 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:03.633930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb25024-0836-430b-8164-b33e8e013b02 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:03.639625 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9631f7-0557-478b-a114-6e819e526d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:03.640327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9631f7-0557-478b-a114-6e819e526d9f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:03.640637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9631f7-0557-478b-a114-6e819e526d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:03.641694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9631f7-0557-478b-a114-6e819e526d9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:03.641694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9631f7-0557-478b-a114-6e819e526d9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:12:03.642017 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9631f7-0557-478b-a114-6e819e526d9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:03.643593 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9631f7-0557-478b-a114-6e819e526d9f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:03.659126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1129/2263] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:12:03.663686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262a0a1-002b-4704-9a48-766b514a8db6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:03.674688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f262a0a1-002b-4704-9a48-766b514a8db6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:03.684234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0f39b-9ead-4646-b691-20dfb7b9c04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:03.685717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f39b-9ead-4646-b691-20dfb7b9c04b admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:03.686073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f39b-9ead-4646-b691-20dfb7b9c04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:03.686431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d0f39b-9ead-4646-b691-20dfb7b9c04b admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:03.687683 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0f39b-9ead-4646-b691-20dfb7b9c04b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:03.689858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d0f39b-9ead-4646-b691-20dfb7b9c04b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:03.734176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9631f7-0557-478b-a114-6e819e526d9f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:03.736039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8f9631f7-0557-478b-a114-6e819e526d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:03.750850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9631f7-0557-478b-a114-6e819e526d9f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:03.755853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:03.756908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:03.757253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:03.762188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] PATH_INFO: `/v3/users/f1a5b8abb0254ad487eb645180c26ca7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:03.762188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a5b8abb0254ad487eb645180c26ca7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:03.762188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:03.791042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1135/2264] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:12:03 2022] POST /identity/v3/projects => generated 371 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:12:03.796062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0f39b-9ead-4646-b691-20dfb7b9c04b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:03.863152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d0f39b-9ead-4646-b691-20dfb7b9c04b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:03.868643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394108d-086e-45d9-95d4-2368d2f8f60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:03.869323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394108d-086e-45d9-95d4-2368d2f8f60f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:03.869606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394108d-086e-45d9-95d4-2368d2f8f60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:03.869882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394108d-086e-45d9-95d4-2368d2f8f60f admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:03.870584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394108d-086e-45d9-95d4-2368d2f8f60f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:03.872858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394108d-086e-45d9-95d4-2368d2f8f60f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:03.977991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a5b8abb0254ad487eb645180c26ca7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:03.980792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1136/2265] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:12:03 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:12:03.985177 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394108d-086e-45d9-95d4-2368d2f8f60f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:03.992019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a5b8abb0254ad487eb645180c26ca7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:03.998384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394108d-086e-45d9-95d4-2368d2f8f60f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:04.001472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a5b8abb0254ad487eb645180c26ca7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:04.002261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a5b8abb0254ad487eb645180c26ca7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:04.002911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3622f8b5-31d7-452f-b927-d802071507b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a5b8abb0254ad487eb645180c26ca7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:04.003897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d2604-32eb-4993-b547-a41ec69b831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:04.004695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d2604-32eb-4993-b547-a41ec69b831e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:04.005044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d2604-32eb-4993-b547-a41ec69b831e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:04.005387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d2604-32eb-4993-b547-a41ec69b831e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:04.006182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d2604-32eb-4993-b547-a41ec69b831e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:04.007868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207d2604-32eb-4993-b547-a41ec69b831e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:04.019700 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1137/2266] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:12:04.024875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d2604-32eb-4993-b547-a41ec69b831e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:04.026634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-207d2604-32eb-4993-b547-a41ec69b831e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:04.048112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207d2604-32eb-4993-b547-a41ec69b831e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:04.048112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743b88-981c-4322-9d97-d3976a9a6ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:04.048112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743b88-981c-4322-9d97-d3976a9a6ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:04.048488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743b88-981c-4322-9d97-d3976a9a6ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:04.048876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd743b88-981c-4322-9d97-d3976a9a6ed2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:04.049719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743b88-981c-4322-9d97-d3976a9a6ed2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:04.051404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd743b88-981c-4322-9d97-d3976a9a6ed2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:04.064655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1138/2267] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:12:04.069258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743b88-981c-4322-9d97-d3976a9a6ed2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:04.079642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd743b88-981c-4322-9d97-d3976a9a6ed2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:04.084659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7533e-7c5f-4082-ad48-d61361612dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:04.085549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7533e-7c5f-4082-ad48-d61361612dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:04.085949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7533e-7c5f-4082-ad48-d61361612dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:04.086227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7533e-7c5f-4082-ad48-d61361612dd3 admin admin] PATH_INFO: `/v3/projects/676875ce1bda482a8b7f0add35f24892/users/5fc73b0178654a1bb8c4540236a05961/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:04.103734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7533e-7c5f-4082-ad48-d61361612dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676875ce1bda482a8b7f0add35f24892, user_id=5fc73b0178654a1bb8c4540236a05961, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:04.107716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd7533e-7c5f-4082-ad48-d61361612dd3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:04.137376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1130/2268] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:12:03 2022] DELETE /identity/v3/users/f1a5b8abb0254ad487eb645180c26ca7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:12:04.142703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5a4f0-08ed-4b16-ba5a-7a8b99a811e1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:04.143149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5a4f0-08ed-4b16-ba5a-7a8b99a811e1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:04.143438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb5a4f0-08ed-4b16-ba5a-7a8b99a811e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:04.166087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2cb5a4f0-08ed-4b16-ba5a-7a8b99a811e1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:04.167342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2cb5a4f0-08ed-4b16-ba5a-7a8b99a811e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:04.202691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1139/2269] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:12:04 2022] PUT /identity/v3/projects/676875ce1bda482a8b7f0add35f24892/users/5fc73b0178654a1bb8c4540236a05961/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:12:04.250987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1131/2270] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:04.261532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7533e-7c5f-4082-ad48-d61361612dd3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:04.263626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9bd7533e-7c5f-4082-ad48-d61361612dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:04.275278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44b08d-be7a-4b2e-a04e-52d51e4dd5fc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:04.275731 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44b08d-be7a-4b2e-a04e-52d51e4dd5fc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:04.276343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c44b08d-be7a-4b2e-a04e-52d51e4dd5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:04.306178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3c44b08d-be7a-4b2e-a04e-52d51e4dd5fc None None] MFA Rules not processed for user `5fc73b0178654a1bb8c4540236a05961`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:04.308436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3c44b08d-be7a-4b2e-a04e-52d51e4dd5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:04.353190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7533e-7c5f-4082-ad48-d61361612dd3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:04.357626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbb9b5-c91d-44a3-8224-d1e5159679e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:04.358450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbb9b5-c91d-44a3-8224-d1e5159679e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:04.358861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbb9b5-c91d-44a3-8224-d1e5159679e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:04.359250 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbb9b5-c91d-44a3-8224-d1e5159679e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:04.393455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1132/2271] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:12:04.407352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44b08d-be7a-4b2e-a04e-52d51e4dd5fc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:04.409336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3c44b08d-be7a-4b2e-a04e-52d51e4dd5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:04.433442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbb9b5-c91d-44a3-8224-d1e5159679e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:04.435192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbb9b5-c91d-44a3-8224-d1e5159679e7 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:04.446151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1140/2272] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:12:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:12:04.484569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c44b08d-be7a-4b2e-a04e-52d51e4dd5fc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:04.488839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b34f0-3e88-46a9-9607-b63733f97842 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2169b05e64224f69bcc1d9ce912a60e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:04.489490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b34f0-3e88-46a9-9607-b63733f97842 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:04.490198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b34f0-3e88-46a9-9607-b63733f97842 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:04.490644 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b34f0-3e88-46a9-9607-b63733f97842 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:04.501512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b34f0-3e88-46a9-9607-b63733f97842 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:04.503210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b34f0-3e88-46a9-9607-b63733f97842 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:04.514240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1133/2273] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:12:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:12:04.691978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:04.749532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:04.940515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbb9b5-c91d-44a3-8224-d1e5159679e7 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:04.942046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fccbb9b5-c91d-44a3-8224-d1e5159679e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:04.956814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbb9b5-c91d-44a3-8224-d1e5159679e7 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:04.968388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:04.969633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:04.969633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:04.969820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] PATH_INFO: `/v3/projects/dbd4635d047b46139e1df4b93c3c61fd` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:04.971269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd4635d047b46139e1df4b93c3c61fd)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:04.973254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:05.103621 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd4635d047b46139e1df4b93c3c61fd', 'request_id': 'req-ca0f2403-19f4-40bb-bd15-2d6065ac0229'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:05.111842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd4635d047b46139e1df4b93c3c61fd', 'request_id': 'req-ca0f2403-19f4-40bb-bd15-2d6065ac0229'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:05.217623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd4635d047b46139e1df4b93c3c61fd', 'request_id': 'req-ca0f2403-19f4-40bb-bd15-2d6065ac0229'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:05.229996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] The token cache is being invalidate because project dbd4635d047b46139e1df4b93c3c61fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:12:05.230287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:05.231031 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ca0f2403-19f4-40bb-bd15-2d6065ac0229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:05.232737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1141/2274] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:12:04 2022] DELETE /identity/v3/projects/dbd4635d047b46139e1df4b93c3c61fd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:12:05.237658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a30a6c-dd79-4f11-8019-aeac6d51b665 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:05.238186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a30a6c-dd79-4f11-8019-aeac6d51b665 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:05.238642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a30a6c-dd79-4f11-8019-aeac6d51b665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:05.257202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-92a30a6c-dd79-4f11-8019-aeac6d51b665 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:05.258426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-92a30a6c-dd79-4f11-8019-aeac6d51b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:05.318857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1134/2275] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:05.326524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126e9ab-e284-40ab-abef-b00c51265977 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:05.326819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126e9ab-e284-40ab-abef-b00c51265977 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:05.328281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e126e9ab-e284-40ab-abef-b00c51265977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:05.363021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e126e9ab-e284-40ab-abef-b00c51265977 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:05.364908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e126e9ab-e284-40ab-abef-b00c51265977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:05.379019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1142/2276] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:05.383488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a30a6c-dd79-4f11-8019-aeac6d51b665 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:05.394473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a30a6c-dd79-4f11-8019-aeac6d51b665 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:05.399404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c5608-7ce1-4b91-8aeb-af55032c4e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:05.400149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c5608-7ce1-4b91-8aeb-af55032c4e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:05.400480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c5608-7ce1-4b91-8aeb-af55032c4e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:05.400766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c5608-7ce1-4b91-8aeb-af55032c4e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:05.401479 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c5608-7ce1-4b91-8aeb-af55032c4e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:12:05.401785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c5608-7ce1-4b91-8aeb-af55032c4e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:05.403586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c5608-7ce1-4b91-8aeb-af55032c4e32 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:05.425328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1135/2277] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:12:05.426576 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126e9ab-e284-40ab-abef-b00c51265977 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:05.436994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e126e9ab-e284-40ab-abef-b00c51265977 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:05.443829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b2fd9-ce9a-4770-8abe-feaf730cbcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:05.444844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b2fd9-ce9a-4770-8abe-feaf730cbcc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:05.445186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b2fd9-ce9a-4770-8abe-feaf730cbcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:05.445546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01b2fd9-ce9a-4770-8abe-feaf730cbcc0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:05.446332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b2fd9-ce9a-4770-8abe-feaf730cbcc0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:05.448505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01b2fd9-ce9a-4770-8abe-feaf730cbcc0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:05.548658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1143/2278] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:12:05 2022] POST /identity/v3/projects => generated 399 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:12:05.553881 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c5608-7ce1-4b91-8aeb-af55032c4e32 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:05.566056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c5608-7ce1-4b91-8aeb-af55032c4e32 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:05.627461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f63309-c304-4e78-86cb-70b329fa2968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:05.628304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63309-c304-4e78-86cb-70b329fa2968 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:05.628592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63309-c304-4e78-86cb-70b329fa2968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:05.628912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f63309-c304-4e78-86cb-70b329fa2968 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:05.629630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f63309-c304-4e78-86cb-70b329fa2968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:05.631621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f63309-c304-4e78-86cb-70b329fa2968 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:05.742737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1136/2279] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:12:05 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:12:05.749254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b2fd9-ce9a-4770-8abe-feaf730cbcc0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:05.757545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01b2fd9-ce9a-4770-8abe-feaf730cbcc0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:05.762124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e11406-c643-4bc4-8f9f-b6839770d6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:05.762951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e11406-c643-4bc4-8f9f-b6839770d6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:05.763345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e11406-c643-4bc4-8f9f-b6839770d6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:05.763611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e11406-c643-4bc4-8f9f-b6839770d6f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:05.764443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e11406-c643-4bc4-8f9f-b6839770d6f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:05.766092 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e11406-c643-4bc4-8f9f-b6839770d6f4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:05.776873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1144/2280] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:12:05.781442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f63309-c304-4e78-86cb-70b329fa2968 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:05.792311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f63309-c304-4e78-86cb-70b329fa2968 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:05.797989 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f91e6f5-ec71-4dd3-8ad1-55b38ca7bb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:05.798658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e6f5-ec71-4dd3-8ad1-55b38ca7bb5b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:05.798987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e6f5-ec71-4dd3-8ad1-55b38ca7bb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:05.799263 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f91e6f5-ec71-4dd3-8ad1-55b38ca7bb5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:05.800030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91e6f5-ec71-4dd3-8ad1-55b38ca7bb5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:05.801638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f91e6f5-ec71-4dd3-8ad1-55b38ca7bb5b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:05.814111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1137/2281] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:12:05.818197 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e11406-c643-4bc4-8f9f-b6839770d6f4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:05.829390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e11406-c643-4bc4-8f9f-b6839770d6f4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:05.834150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9013635-8aee-4043-8a48-6a90340092b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:05.835053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9013635-8aee-4043-8a48-6a90340092b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:05.835329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9013635-8aee-4043-8a48-6a90340092b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:05.835603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9013635-8aee-4043-8a48-6a90340092b3 admin admin] PATH_INFO: `/v3/projects/7e7d7a2a486f4e569f006044f4fc4258/users/27e10ab9568f411585e6a0c3b9aa4447/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:05.855019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9013635-8aee-4043-8a48-6a90340092b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7d7a2a486f4e569f006044f4fc4258, user_id=27e10ab9568f411585e6a0c3b9aa4447, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:05.858728 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9013635-8aee-4043-8a48-6a90340092b3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:05.938264 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:06.013762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1145/2282] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:12:05 2022] PUT /identity/v3/projects/7e7d7a2a486f4e569f006044f4fc4258/users/27e10ab9568f411585e6a0c3b9aa4447/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:12:06.024667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1ed5-2523-4a85-a32a-2969e940cb02 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:06.025114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1ed5-2523-4a85-a32a-2969e940cb02 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:06.025498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086d1ed5-2523-4a85-a32a-2969e940cb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:06.059168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-086d1ed5-2523-4a85-a32a-2969e940cb02 None None] MFA Rules not processed for user `27e10ab9568f411585e6a0c3b9aa4447`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:06.060715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-086d1ed5-2523-4a85-a32a-2969e940cb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:06.175718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1138/2283] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:12:06.203464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9013635-8aee-4043-8a48-6a90340092b3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:06.207064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a9013635-8aee-4043-8a48-6a90340092b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:06.316386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9013635-8aee-4043-8a48-6a90340092b3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:06.320487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de4e33-7c1b-4df6-93bd-9bc4d56636f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:06.321245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4e33-7c1b-4df6-93bd-9bc4d56636f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:06.321747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4e33-7c1b-4df6-93bd-9bc4d56636f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:06.322102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de4e33-7c1b-4df6-93bd-9bc4d56636f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:06.335246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de4e33-7c1b-4df6-93bd-9bc4d56636f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:06.336840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de4e33-7c1b-4df6-93bd-9bc4d56636f3 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:06.372826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1146/2284] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:12:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:12:06.390089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:08.149472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:08.257881 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:10.034755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:10.486980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:10.827726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:11.298069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:11.486276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:12.933009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:12.984341 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:13.062683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d1ed5-2523-4a85-a32a-2969e940cb02 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:13.127860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086d1ed5-2523-4a85-a32a-2969e940cb02 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:13.132630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:13.133500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:13.133780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:13.134058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] PATH_INFO: `/v3/users/27e10ab9568f411585e6a0c3b9aa4447` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:13.135284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27e10ab9568f411585e6a0c3b9aa4447)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:13.137837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:13.357787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27e10ab9568f411585e6a0c3b9aa4447'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:13.372635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27e10ab9568f411585e6a0c3b9aa4447'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:13.380767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27e10ab9568f411585e6a0c3b9aa4447'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:13.381542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27e10ab9568f411585e6a0c3b9aa4447'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:13.382294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71ff277e-1ba8-433c-962a-a68463519c94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27e10ab9568f411585e6a0c3b9aa4447'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:13.480584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1139/2285] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:12:13 2022] DELETE /identity/v3/users/27e10ab9568f411585e6a0c3b9aa4447 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:12:13.486204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29407955-a05c-4f8a-9a26-557a40fda7c4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:13.486494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29407955-a05c-4f8a-9a26-557a40fda7c4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:13.486772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29407955-a05c-4f8a-9a26-557a40fda7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:13.508311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-29407955-a05c-4f8a-9a26-557a40fda7c4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:13.521434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-29407955-a05c-4f8a-9a26-557a40fda7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:13.523203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140102f2-4a84-4023-ab18-ec496817c207 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:13.524299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140102f2-4a84-4023-ab18-ec496817c207 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:13.524623 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140102f2-4a84-4023-ab18-ec496817c207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:13.547543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-140102f2-4a84-4023-ab18-ec496817c207 None None] MFA Rules not processed for user `66801c15461d4b419949b4959805306a`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:13.549866 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-140102f2-4a84-4023-ab18-ec496817c207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:13.586383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1147/2286] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:13.599085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29407955-a05c-4f8a-9a26-557a40fda7c4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:13.600614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-29407955-a05c-4f8a-9a26-557a40fda7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:13.615402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1140/2287] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:12:13.669363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29407955-a05c-4f8a-9a26-557a40fda7c4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:13.672990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0423d3-d31b-4bb2-9412-7985e58de26f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:13.673625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0423d3-d31b-4bb2-9412-7985e58de26f service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:13.673900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0423d3-d31b-4bb2-9412-7985e58de26f service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:13.674167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0423d3-d31b-4bb2-9412-7985e58de26f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:13.683032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0423d3-d31b-4bb2-9412-7985e58de26f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:13.686227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0423d3-d31b-4bb2-9412-7985e58de26f service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:13.696073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1148/2288] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:12:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:12:13.726808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:14.006268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:14.147155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140102f2-4a84-4023-ab18-ec496817c207 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:14.148856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-140102f2-4a84-4023-ab18-ec496817c207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:14.166037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140102f2-4a84-4023-ab18-ec496817c207 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:14.172983 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:14.172983 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:14.172983 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:14.172983 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] PATH_INFO: `/v3/projects/7e7d7a2a486f4e569f006044f4fc4258` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:14.173663 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7d7a2a486f4e569f006044f4fc4258)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:14.175494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:14.203198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:14.270063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7d7a2a486f4e569f006044f4fc4258', 'request_id': 'req-97728b93-3469-4f5d-8aff-b0927078643a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:14.275680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7d7a2a486f4e569f006044f4fc4258', 'request_id': 'req-97728b93-3469-4f5d-8aff-b0927078643a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:14.381651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7d7a2a486f4e569f006044f4fc4258', 'request_id': 'req-97728b93-3469-4f5d-8aff-b0927078643a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:14.394056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] The token cache is being invalidate because project 7e7d7a2a486f4e569f006044f4fc4258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:12:14.394487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:14.395149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:14.396740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1141/2289] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:12:14 2022] DELETE /identity/v3/projects/7e7d7a2a486f4e569f006044f4fc4258 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:12:14.680651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:15.093554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:15.292195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:15.389163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:15.622820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:15.640629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:15.842230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:15.869414 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:16.033176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:16.130519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:16.158912 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:16.267882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:16.297595 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:16.497746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:16.531958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:16.669499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:16.810901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:16.879163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.039475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.067805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.223535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.246574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.331949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.349154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.440752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.457853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.526487 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.543705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.612515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.639624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.754667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.789353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.943212 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:17.971760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:18.245195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:18.288267 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:18.691041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:18.725262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:18.897508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:18.967274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:19.040136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:19.057264 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:19.170384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:19.221639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:29.143134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=58 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:29.314358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=8,keystone:SELECT=54,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:30.913388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f001de-f042-4803-bd42-09f254773a73 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:30.913914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f001de-f042-4803-bd42-09f254773a73 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:30.913914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f001de-f042-4803-bd42-09f254773a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:30.934527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-10f001de-f042-4803-bd42-09f254773a73 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:30.936072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-10f001de-f042-4803-bd42-09f254773a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:31.008385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1149/2290] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:12:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:31.021331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:31.022834 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:31.095673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97728b93-3469-4f5d-8aff-b0927078643a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:31.101420 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101d865-34b4-4f47-8da7-e6969b21bd02 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:31.102097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101d865-34b4-4f47-8da7-e6969b21bd02 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:31.102378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101d865-34b4-4f47-8da7-e6969b21bd02 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:31.102653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e101d865-34b4-4f47-8da7-e6969b21bd02 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:31.110949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101d865-34b4-4f47-8da7-e6969b21bd02 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:31.112563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e101d865-34b4-4f47-8da7-e6969b21bd02 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:31.120576 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1142/2291] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:12:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:12:31.837745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b65f6-9b00-49b5-a9d6-b7fd66b6a059 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:31.838040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b65f6-9b00-49b5-a9d6-b7fd66b6a059 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:31.839052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b65f6-9b00-49b5-a9d6-b7fd66b6a059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:31.873703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-359b65f6-9b00-49b5-a9d6-b7fd66b6a059 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:31.875017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-359b65f6-9b00-49b5-a9d6-b7fd66b6a059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:31.885123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1150/2292] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:12:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:31.910801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101d865-34b4-4f47-8da7-e6969b21bd02 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:31.939001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e101d865-34b4-4f47-8da7-e6969b21bd02 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:31.958638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babef719-7fb4-414f-9ac1-219e2cc3d3f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:31.959550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babef719-7fb4-414f-9ac1-219e2cc3d3f4 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:31.960635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babef719-7fb4-414f-9ac1-219e2cc3d3f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:31.961526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babef719-7fb4-414f-9ac1-219e2cc3d3f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:32.000168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babef719-7fb4-414f-9ac1-219e2cc3d3f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:32.004864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babef719-7fb4-414f-9ac1-219e2cc3d3f4 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:32.020370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1143/2293] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:12:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:12:41.865352 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=28 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:42.016273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=38 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:46.150370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e26fc-7e1b-4333-9232-3deab24297be None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:46.150952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e26fc-7e1b-4333-9232-3deab24297be None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:46.150952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e26fc-7e1b-4333-9232-3deab24297be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:46.170842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-015e26fc-7e1b-4333-9232-3deab24297be None None] MFA Rules not processed for user `111b06722ed54bcaab771e4788015cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:46.172124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-015e26fc-7e1b-4333-9232-3deab24297be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:46.255073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1151/2294] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:12:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:48.496922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babef719-7fb4-414f-9ac1-219e2cc3d3f4 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:48.496922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-babef719-7fb4-414f-9ac1-219e2cc3d3f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:48.580143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babef719-7fb4-414f-9ac1-219e2cc3d3f4 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:48.591968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71082f8e-a8eb-4091-9644-5916b962afa6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e52a3464d8f4a3fa16a102336a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:48.591968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71082f8e-a8eb-4091-9644-5916b962afa6 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:48.591968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71082f8e-a8eb-4091-9644-5916b962afa6 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:48.591968 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71082f8e-a8eb-4091-9644-5916b962afa6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:48.592478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-71082f8e-a8eb-4091-9644-5916b962afa6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:48.602728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71082f8e-a8eb-4091-9644-5916b962afa6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:48.604318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71082f8e-a8eb-4091-9644-5916b962afa6 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:48.651673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1144/2295] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:12:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:12:55.070926 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64307c-7eae-488e-8388-d29d1b00d224 None None] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:55.073371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64307c-7eae-488e-8388-d29d1b00d224 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:55.073371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d64307c-7eae-488e-8388-d29d1b00d224 None None] PATH_INFO: `/` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:55.074778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1152/2296] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:12:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:12:55.081912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377640-8eab-45fd-a2be-02ac3a5e7d46 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:55.082430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377640-8eab-45fd-a2be-02ac3a5e7d46 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:55.082540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c377640-8eab-45fd-a2be-02ac3a5e7d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:55.102169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1c377640-8eab-45fd-a2be-02ac3a5e7d46 None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:55.107790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1c377640-8eab-45fd-a2be-02ac3a5e7d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:55.180672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1145/2297] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:12:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:12:55.193195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64307c-7eae-488e-8388-d29d1b00d224 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:55.195067 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7d64307c-7eae-488e-8388-d29d1b00d224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:55.275617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d64307c-7eae-488e-8388-d29d1b00d224 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:55.279363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799608bd-5324-4bba-b832-3e9d3da4ff04 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2169b05e64224f69bcc1d9ce912a60e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:55.280116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799608bd-5324-4bba-b832-3e9d3da4ff04 service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:55.280459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799608bd-5324-4bba-b832-3e9d3da4ff04 service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:55.280794 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799608bd-5324-4bba-b832-3e9d3da4ff04 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:55.291852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799608bd-5324-4bba-b832-3e9d3da4ff04 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:55.294928 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799608bd-5324-4bba-b832-3e9d3da4ff04 service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:55.320392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1153/2298] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:12:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:12:55.572001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89d562-23d4-477d-b363-ba26c94af13a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:55.572380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89d562-23d4-477d-b363-ba26c94af13a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:55.572747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b89d562-23d4-477d-b363-ba26c94af13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:55.621426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4b89d562-23d4-477d-b363-ba26c94af13a None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:55.622762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4b89d562-23d4-477d-b363-ba26c94af13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:55.630592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1146/2299] 10.222.0.85 () {58 vars in 967 bytes} [Wed Jul 20 22:12:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:55.644887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799608bd-5324-4bba-b832-3e9d3da4ff04 service glance] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:55.657261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799608bd-5324-4bba-b832-3e9d3da4ff04 service glance] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:55.665628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2228ee-7968-4346-b51c-1af6bc3767b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:55.666466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2228ee-7968-4346-b51c-1af6bc3767b1 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:55.667568 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2228ee-7968-4346-b51c-1af6bc3767b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:55.674761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2228ee-7968-4346-b51c-1af6bc3767b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:55.676781 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5dfec-a2c0-4f64-a7ec-1d5ced2d3495 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:55.677261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5dfec-a2c0-4f64-a7ec-1d5ced2d3495 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:55.677705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c5dfec-a2c0-4f64-a7ec-1d5ced2d3495 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:55.680461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1147/2300] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:12:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 20 22:12:55.690345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2228ee-7968-4346-b51c-1af6bc3767b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:55.692998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2228ee-7968-4346-b51c-1af6bc3767b1 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:55.693800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacdbe-63fe-47e7-913d-8126c4928ae2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:55.694255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacdbe-63fe-47e7-913d-8126c4928ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:55.697893 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacdbe-63fe-47e7-913d-8126c4928ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:55.707312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1154/2301] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:12:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:12:55.735183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f7eacdbe-63fe-47e7-913d-8126c4928ae2 None None] MFA Rules not processed for user `2ad07969d5a043e7b83e403da35120da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:55.736422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f7eacdbe-63fe-47e7-913d-8126c4928ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:55.808636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1148/2302] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:12:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:55.837800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2228ee-7968-4346-b51c-1af6bc3767b1 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:55.843366 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3c2228ee-7968-4346-b51c-1af6bc3767b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:55.855784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2228ee-7968-4346-b51c-1af6bc3767b1 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:55.862132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9ca58-62f0-411e-b475-b81ea1fc3a3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:55.862985 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9ca58-62f0-411e-b475-b81ea1fc3a3a service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:55.863414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9ca58-62f0-411e-b475-b81ea1fc3a3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:55.864786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9ca58-62f0-411e-b475-b81ea1fc3a3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:55.877083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9ca58-62f0-411e-b475-b81ea1fc3a3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:55.878904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9ca58-62f0-411e-b475-b81ea1fc3a3a service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:55.890737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1155/2303] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:12:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:12:56.111942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb5d77-4317-4b04-8080-3a6196c50a5f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:56.112421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb5d77-4317-4b04-8080-3a6196c50a5f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:56.112530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bb5d77-4317-4b04-8080-3a6196c50a5f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:56.114210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1149/2304] 10.222.0.85 () {54 vars in 921 bytes} [Wed Jul 20 22:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 20 22:12:56.137958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c1160-2cee-49dd-8d66-b7611801d74a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:56.138548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c1160-2cee-49dd-8d66-b7611801d74a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:56.138548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c1160-2cee-49dd-8d66-b7611801d74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:56.174966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-f09c1160-2cee-49dd-8d66-b7611801d74a None None] MFA Rules not processed for user `5e192a50b09b49b4b7db2508ecf75af5`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:56.176750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f09c1160-2cee-49dd-8d66-b7611801d74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:56.191103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1156/2305] 10.222.0.85 () {58 vars in 1018 bytes} [Wed Jul 20 22:12:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:56.216211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb5d77-4317-4b04-8080-3a6196c50a5f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:56.235076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bb5d77-4317-4b04-8080-3a6196c50a5f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:56.235076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6ad2-f307-48b6-a445-96f94bd82406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:56.235076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6ad2-f307-48b6-a445-96f94bd82406 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:56.235412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6ad2-f307-48b6-a445-96f94bd82406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:56.235570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821b6ad2-f307-48b6-a445-96f94bd82406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:56.251057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b6ad2-f307-48b6-a445-96f94bd82406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:56.252691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821b6ad2-f307-48b6-a445-96f94bd82406 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:56.265871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1150/2306] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:12:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:12:58.211138 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efe262-7c05-4d6c-b540-aa31d25942fe None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:58.211669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efe262-7c05-4d6c-b540-aa31d25942fe None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:58.211669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77efe262-7c05-4d6c-b540-aa31d25942fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:58.236417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-77efe262-7c05-4d6c-b540-aa31d25942fe None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:12:58.237659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-77efe262-7c05-4d6c-b540-aa31d25942fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:58.317151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1157/2307] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:12:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:12:58.339560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6ad2-f307-48b6-a445-96f94bd82406 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:58.341668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-821b6ad2-f307-48b6-a445-96f94bd82406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:58.357112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821b6ad2-f307-48b6-a445-96f94bd82406 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:58.362543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651ce6d-bc88-4812-9acd-ee780c28a1f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:58.364639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651ce6d-bc88-4812-9acd-ee780c28a1f5 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:58.364639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651ce6d-bc88-4812-9acd-ee780c28a1f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:58.364639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0651ce6d-bc88-4812-9acd-ee780c28a1f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:58.373214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651ce6d-bc88-4812-9acd-ee780c28a1f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:58.374803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0651ce6d-bc88-4812-9acd-ee780c28a1f5 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:58.378753 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:58.385168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1151/2308] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:12:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:12:59.289838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efe262-7c05-4d6c-b540-aa31d25942fe None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:12:59.290892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-77efe262-7c05-4d6c-b540-aa31d25942fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:12:59.304430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77efe262-7c05-4d6c-b540-aa31d25942fe None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:12:59.309755 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:12:59.312689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:12:59.312689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:12:59.312689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] PATH_INFO: `/v3/users/3437fb4f6caf4ba185cc10ce9f449353` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:12:59.312689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3437fb4f6caf4ba185cc10ce9f449353)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:12:59.314602 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:12:59.327020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:12:59.590275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3437fb4f6caf4ba185cc10ce9f449353'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:59.685770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3437fb4f6caf4ba185cc10ce9f449353'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:59.693458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3437fb4f6caf4ba185cc10ce9f449353'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:59.694133 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3437fb4f6caf4ba185cc10ce9f449353'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:59.707261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-68fdcd7e-127f-4f48-a395-02533372ac53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3437fb4f6caf4ba185cc10ce9f449353'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:12:59.713397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1158/2309] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:12:59 2022] DELETE /identity/v3/users/3437fb4f6caf4ba185cc10ce9f449353 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:12:59.996393 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651ce6d-bc88-4812-9acd-ee780c28a1f5 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:00.006707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0651ce6d-bc88-4812-9acd-ee780c28a1f5 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:00.076653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:00.077506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:00.077784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:00.078099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] PATH_INFO: `/v3/projects/593dd0569966485db33412a201d9b311` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:00.079259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=593dd0569966485db33412a201d9b311)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:00.081182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:00.201251 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593dd0569966485db33412a201d9b311', 'request_id': 'req-22d521dc-9ddd-4018-9bda-9e89549ca89c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:00.206732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593dd0569966485db33412a201d9b311', 'request_id': 'req-22d521dc-9ddd-4018-9bda-9e89549ca89c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:00.296851 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593dd0569966485db33412a201d9b311', 'request_id': 'req-22d521dc-9ddd-4018-9bda-9e89549ca89c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:00.310003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] The token cache is being invalidate because project 593dd0569966485db33412a201d9b311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:13:00.312351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:00.312351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22d521dc-9ddd-4018-9bda-9e89549ca89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:00.313059 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1152/2310] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:12:59 2022] DELETE /identity/v3/projects/593dd0569966485db33412a201d9b311 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:13:00.319299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bfbaa-cb85-4489-b661-1240ee7463b4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:00.319809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bfbaa-cb85-4489-b661-1240ee7463b4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:00.320131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bfbaa-cb85-4489-b661-1240ee7463b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:00.341739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e29bfbaa-cb85-4489-b661-1240ee7463b4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:00.342950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e29bfbaa-cb85-4489-b661-1240ee7463b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:00.404248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1159/2311] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:13:00.411855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da41b-b5ea-4e88-a67c-117479ec9422 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:00.412165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da41b-b5ea-4e88-a67c-117479ec9422 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:00.412444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da41b-b5ea-4e88-a67c-117479ec9422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:00.431067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4e3da41b-b5ea-4e88-a67c-117479ec9422 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:00.432300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e3da41b-b5ea-4e88-a67c-117479ec9422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:00.440841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1153/2312] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:13:00.447188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bfbaa-cb85-4489-b661-1240ee7463b4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:00.458100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bfbaa-cb85-4489-b661-1240ee7463b4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:00.462707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6290e1-aa47-4c29-b967-3088ad1b3212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:00.463365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6290e1-aa47-4c29-b967-3088ad1b3212 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:00.463648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6290e1-aa47-4c29-b967-3088ad1b3212 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:00.463965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6290e1-aa47-4c29-b967-3088ad1b3212 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:00.464892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6290e1-aa47-4c29-b967-3088ad1b3212 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:13:00.465203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6290e1-aa47-4c29-b967-3088ad1b3212 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:00.466903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6290e1-aa47-4c29-b967-3088ad1b3212 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:00.479094 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1160/2313] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:13:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:13:00.483969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3da41b-b5ea-4e88-a67c-117479ec9422 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:00.493213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3da41b-b5ea-4e88-a67c-117479ec9422 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:00.498547 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898921a2-9ecb-418e-bff6-8b466e5c8756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:00.499184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898921a2-9ecb-418e-bff6-8b466e5c8756 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:00.499462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898921a2-9ecb-418e-bff6-8b466e5c8756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:00.499733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898921a2-9ecb-418e-bff6-8b466e5c8756 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:00.500453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898921a2-9ecb-418e-bff6-8b466e5c8756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:00.502388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898921a2-9ecb-418e-bff6-8b466e5c8756 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:00.619064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1154/2314] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:13:00 2022] POST /identity/v3/projects => generated 369 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:13:00.623427 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6290e1-aa47-4c29-b967-3088ad1b3212 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:00.634246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6290e1-aa47-4c29-b967-3088ad1b3212 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:00.694310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2feeda-9167-4b5a-b8f6-414f067bf313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:00.694980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2feeda-9167-4b5a-b8f6-414f067bf313 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:00.695257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2feeda-9167-4b5a-b8f6-414f067bf313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:00.695528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2feeda-9167-4b5a-b8f6-414f067bf313 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:00.696258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2feeda-9167-4b5a-b8f6-414f067bf313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:00.698208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2feeda-9167-4b5a-b8f6-414f067bf313 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:00.794933 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1161/2315] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:13:00 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:13:00.804843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898921a2-9ecb-418e-bff6-8b466e5c8756 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:00.815706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898921a2-9ecb-418e-bff6-8b466e5c8756 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:00.820761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3805a-b352-435e-a3b1-3b9b39d2077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:00.821456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3805a-b352-435e-a3b1-3b9b39d2077d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:00.821742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3805a-b352-435e-a3b1-3b9b39d2077d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:00.822029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3805a-b352-435e-a3b1-3b9b39d2077d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:00.822776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3805a-b352-435e-a3b1-3b9b39d2077d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:00.824639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3805a-b352-435e-a3b1-3b9b39d2077d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:00.835571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1155/2316] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:13:00.840286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2feeda-9167-4b5a-b8f6-414f067bf313 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:00.846962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:13:00.851047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2feeda-9167-4b5a-b8f6-414f067bf313 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:00.856415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a6432-d5c4-47e3-8b4c-18b2b12e7bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:00.857149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6432-d5c4-47e3-8b4c-18b2b12e7bbe admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:00.862416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6432-d5c4-47e3-8b4c-18b2b12e7bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:00.862416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6432-d5c4-47e3-8b4c-18b2b12e7bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:00.862416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a6432-d5c4-47e3-8b4c-18b2b12e7bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:00.862416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a6432-d5c4-47e3-8b4c-18b2b12e7bbe admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:00.874720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1162/2317] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:13:00.879133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3805a-b352-435e-a3b1-3b9b39d2077d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:00.890235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3805a-b352-435e-a3b1-3b9b39d2077d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:00.895508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834579a6-4968-43e0-a45c-a549c94bbb9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:00.896625 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834579a6-4968-43e0-a45c-a549c94bbb9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:00.896914 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834579a6-4968-43e0-a45c-a549c94bbb9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:00.897188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834579a6-4968-43e0-a45c-a549c94bbb9f admin admin] PATH_INFO: `/v3/projects/f6bb5b81ef824a7fadf70e45863753a6/users/e88f63d14b11499fb28d324313c8b5ec/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:00.913741 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834579a6-4968-43e0-a45c-a549c94bbb9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bb5b81ef824a7fadf70e45863753a6, user_id=e88f63d14b11499fb28d324313c8b5ec, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:00.917737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834579a6-4968-43e0-a45c-a549c94bbb9f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:01.110640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1156/2318] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:13:00 2022] PUT /identity/v3/projects/f6bb5b81ef824a7fadf70e45863753a6/users/e88f63d14b11499fb28d324313c8b5ec/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:13:01.121723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893390-3855-48ce-a23d-87de41d2a84d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:01.122001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893390-3855-48ce-a23d-87de41d2a84d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:01.122284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78893390-3855-48ce-a23d-87de41d2a84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:01.148346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-78893390-3855-48ce-a23d-87de41d2a84d None None] MFA Rules not processed for user `e88f63d14b11499fb28d324313c8b5ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:01.149641 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-78893390-3855-48ce-a23d-87de41d2a84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:01.222158 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1163/2319] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:13:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:13:01.233712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834579a6-4968-43e0-a45c-a549c94bbb9f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:01.235424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-834579a6-4968-43e0-a45c-a549c94bbb9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:01.263996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:13:01.300049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834579a6-4968-43e0-a45c-a549c94bbb9f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:01.303779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018ba5-1d12-44ac-a134-5b3ad55ca6e6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2169b05e64224f69bcc1d9ce912a60e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:01.304559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018ba5-1d12-44ac-a134-5b3ad55ca6e6 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:01.304821 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018ba5-1d12-44ac-a134-5b3ad55ca6e6 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:01.305118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa018ba5-1d12-44ac-a134-5b3ad55ca6e6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:01.314843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa018ba5-1d12-44ac-a134-5b3ad55ca6e6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:01.316431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa018ba5-1d12-44ac-a134-5b3ad55ca6e6 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:01.327784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1157/2320] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:13:01 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:13:02.902915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac439679-c6db-4b18-9a07-4fd91e231d9c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:02.903397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac439679-c6db-4b18-9a07-4fd91e231d9c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:02.903539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac439679-c6db-4b18-9a07-4fd91e231d9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:02.923473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ac439679-c6db-4b18-9a07-4fd91e231d9c None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:02.924732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ac439679-c6db-4b18-9a07-4fd91e231d9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:02.988624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1164/2321] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:13:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:13:03.035411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018ba5-1d12-44ac-a134-5b3ad55ca6e6 service glance] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:03.036964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fa018ba5-1d12-44ac-a134-5b3ad55ca6e6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:03.130444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa018ba5-1d12-44ac-a134-5b3ad55ca6e6 service glance] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:03.136877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f95312-db28-4942-a89d-bdb857488fc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:03.137856 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f95312-db28-4942-a89d-bdb857488fc6 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:03.138358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f95312-db28-4942-a89d-bdb857488fc6 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:03.138839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f95312-db28-4942-a89d-bdb857488fc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:03.160054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f95312-db28-4942-a89d-bdb857488fc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:03.162143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f95312-db28-4942-a89d-bdb857488fc6 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:03.180761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1158/2322] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:13:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:13:03.684684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c596372-a8a1-4168-b89a-cbd73e8fef8b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:03.684998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c596372-a8a1-4168-b89a-cbd73e8fef8b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:03.685357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c596372-a8a1-4168-b89a-cbd73e8fef8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:03.706699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0c596372-a8a1-4168-b89a-cbd73e8fef8b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:03.708259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0c596372-a8a1-4168-b89a-cbd73e8fef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:03.793752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1165/2323] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:13:03.800991 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f95312-db28-4942-a89d-bdb857488fc6 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:03.802582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-37f95312-db28-4942-a89d-bdb857488fc6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:03.816449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c596372-a8a1-4168-b89a-cbd73e8fef8b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:03.819067 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0c596372-a8a1-4168-b89a-cbd73e8fef8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:03.827913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f95312-db28-4942-a89d-bdb857488fc6 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:03.834631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:03.835512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:03.835835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:03.836109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] PATH_INFO: `/v3/users/5fc73b0178654a1bb8c4540236a05961` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:03.837363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fc73b0178654a1bb8c4540236a05961)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:03.840191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:03.858062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:13:03.903497 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c596372-a8a1-4168-b89a-cbd73e8fef8b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:03.909743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921846b2-32ea-4604-ba6f-a7837a7e7874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:03.910481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921846b2-32ea-4604-ba6f-a7837a7e7874 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:03.910776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921846b2-32ea-4604-ba6f-a7837a7e7874 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:03.911055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921846b2-32ea-4604-ba6f-a7837a7e7874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:03.921720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921846b2-32ea-4604-ba6f-a7837a7e7874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:03.923850 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921846b2-32ea-4604-ba6f-a7837a7e7874 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:03.935911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1166/2324] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:13:04.093732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fc73b0178654a1bb8c4540236a05961'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:04.109388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fc73b0178654a1bb8c4540236a05961'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:04.118554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fc73b0178654a1bb8c4540236a05961'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:04.119464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fc73b0178654a1bb8c4540236a05961'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:04.120175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fc73b0178654a1bb8c4540236a05961'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:04.229063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1159/2325] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:13:03 2022] DELETE /identity/v3/users/5fc73b0178654a1bb8c4540236a05961 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:13:04.233703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748683-2cf1-41fb-80ab-60f224c142b8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:04.233990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748683-2cf1-41fb-80ab-60f224c142b8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:04.234268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03748683-2cf1-41fb-80ab-60f224c142b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:04.255140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-03748683-2cf1-41fb-80ab-60f224c142b8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:04.256540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-03748683-2cf1-41fb-80ab-60f224c142b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:04.326682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1167/2326] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:13:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:13:04.340121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:04.342824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:04.410064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:13:04.455874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce280f8-5793-4d0f-b8fc-458d3e95c723 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:04.460072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982066cb-0309-4d98-ac01-a603b03e363d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:04.460735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982066cb-0309-4d98-ac01-a603b03e363d service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:04.461027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982066cb-0309-4d98-ac01-a603b03e363d service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:04.461300 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982066cb-0309-4d98-ac01-a603b03e363d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:04.475055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982066cb-0309-4d98-ac01-a603b03e363d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:04.476978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982066cb-0309-4d98-ac01-a603b03e363d service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:04.501665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1160/2327] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:13:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:13:05.009077 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748683-2cf1-41fb-80ab-60f224c142b8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:05.010573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-03748683-2cf1-41fb-80ab-60f224c142b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:05.022781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03748683-2cf1-41fb-80ab-60f224c142b8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:05.027557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:05.028489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:05.028734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:05.029118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] PATH_INFO: `/v3/projects/676875ce1bda482a8b7f0add35f24892` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:05.030196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=676875ce1bda482a8b7f0add35f24892)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:05.032239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:05.155216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676875ce1bda482a8b7f0add35f24892', 'request_id': 'req-4eed5153-03d2-4415-a48f-22edc36f1035'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:05.160631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676875ce1bda482a8b7f0add35f24892', 'request_id': 'req-4eed5153-03d2-4415-a48f-22edc36f1035'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:05.249987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676875ce1bda482a8b7f0add35f24892', 'request_id': 'req-4eed5153-03d2-4415-a48f-22edc36f1035'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:05.263253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] The token cache is being invalidate because project 676875ce1bda482a8b7f0add35f24892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:13:05.263459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:05.264140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:05.266092 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1168/2328] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:13:05 2022] DELETE /identity/v3/projects/676875ce1bda482a8b7f0add35f24892 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:13:14.561822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=13 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:13:15.259594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:13:22.657401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67c98a-ae21-42c5-b38e-b23328797b1b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:22.658555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67c98a-ae21-42c5-b38e-b23328797b1b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:22.659043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa67c98a-ae21-42c5-b38e-b23328797b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:22.690559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aa67c98a-ae21-42c5-b38e-b23328797b1b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:22.692704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aa67c98a-ae21-42c5-b38e-b23328797b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:22.781945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1161/2329] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:13:22.803029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:22.805281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:22.895273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed5153-03d2-4415-a48f-22edc36f1035 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:22.895273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bed5c3-e416-4f96-86c5-be8adff6d45d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:22.895273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bed5c3-e416-4f96-86c5-be8adff6d45d service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:22.895705 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bed5c3-e416-4f96-86c5-be8adff6d45d service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:22.896272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bed5c3-e416-4f96-86c5-be8adff6d45d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:22.907151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bed5c3-e416-4f96-86c5-be8adff6d45d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:22.909171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bed5c3-e416-4f96-86c5-be8adff6d45d service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:22.921841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1169/2330] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:13:27.481143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e97b-6f70-4c0a-8f1a-bc090132c9bc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:27.481703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e97b-6f70-4c0a-8f1a-bc090132c9bc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:27.481703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef97e97b-6f70-4c0a-8f1a-bc090132c9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:27.500058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ef97e97b-6f70-4c0a-8f1a-bc090132c9bc None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:27.501406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ef97e97b-6f70-4c0a-8f1a-bc090132c9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:27.509354 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1162/2331] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:13:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:13:27.544830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bed5c3-e416-4f96-86c5-be8adff6d45d service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:27.556252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bed5c3-e416-4f96-86c5-be8adff6d45d service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:27.561895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93f228-aabf-4518-bfe9-0102c5b6350c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:27.562527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93f228-aabf-4518-bfe9-0102c5b6350c service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:27.562810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93f228-aabf-4518-bfe9-0102c5b6350c service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:27.563088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a93f228-aabf-4518-bfe9-0102c5b6350c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:27.571609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93f228-aabf-4518-bfe9-0102c5b6350c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:27.573740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a93f228-aabf-4518-bfe9-0102c5b6350c service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:27.583450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1170/2332] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:13:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:13:28.655547 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e13bc-9f7c-4dea-a4de-23a1af66553c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:28.656094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e13bc-9f7c-4dea-a4de-23a1af66553c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:28.656575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e13bc-9f7c-4dea-a4de-23a1af66553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:28.677427 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c11e13bc-9f7c-4dea-a4de-23a1af66553c None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:28.679110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c11e13bc-9f7c-4dea-a4de-23a1af66553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:28.740569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1163/2333] 10.222.0.85 () {58 vars in 967 bytes} [Wed Jul 20 22:13:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:13:28.753344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93f228-aabf-4518-bfe9-0102c5b6350c service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:28.754726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1a93f228-aabf-4518-bfe9-0102c5b6350c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:28.823077 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a93f228-aabf-4518-bfe9-0102c5b6350c service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:28.828092 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a83e43b-1301-4549-bcd5-325616a228b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:28.828737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83e43b-1301-4549-bcd5-325616a228b8 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:28.829016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83e43b-1301-4549-bcd5-325616a228b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:28.829288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a83e43b-1301-4549-bcd5-325616a228b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:28.837540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83e43b-1301-4549-bcd5-325616a228b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:28.839720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a83e43b-1301-4549-bcd5-325616a228b8 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:28.847779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1171/2334] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:13:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:13:29.684215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e13bc-9f7c-4dea-a4de-23a1af66553c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:29.685758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c11e13bc-9f7c-4dea-a4de-23a1af66553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:29.700889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e13bc-9f7c-4dea-a4de-23a1af66553c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:29.706477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:29.707372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:29.707660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:29.707959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] PATH_INFO: `/v3/users/e88f63d14b11499fb28d324313c8b5ec` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:29.709229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88f63d14b11499fb28d324313c8b5ec)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:29.712424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:29.934218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88f63d14b11499fb28d324313c8b5ec'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:29.947161 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88f63d14b11499fb28d324313c8b5ec'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:29.955650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88f63d14b11499fb28d324313c8b5ec'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:29.956490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88f63d14b11499fb28d324313c8b5ec'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:29.957163 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88f63d14b11499fb28d324313c8b5ec'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:30.046749 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1164/2335] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:13:29 2022] DELETE /identity/v3/users/e88f63d14b11499fb28d324313c8b5ec => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:13:30.051346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb294c5-2c01-4ad0-8dd2-7fdb9d77ae57 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:30.051813 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb294c5-2c01-4ad0-8dd2-7fdb9d77ae57 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:30.051907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb294c5-2c01-4ad0-8dd2-7fdb9d77ae57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:30.069612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2cb294c5-2c01-4ad0-8dd2-7fdb9d77ae57 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:30.070822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2cb294c5-2c01-4ad0-8dd2-7fdb9d77ae57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:30.130011 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1172/2336] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:13:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:13:30.139835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:30.141292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:30.157026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:13:30.202248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf22ab4-2d80-4a8a-8ac9-4c59df0cc352 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:30.205793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490689b-0349-4821-87a7-7c8d32121b92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:30.206434 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490689b-0349-4821-87a7-7c8d32121b92 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:30.206719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490689b-0349-4821-87a7-7c8d32121b92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:30.206996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490689b-0349-4821-87a7-7c8d32121b92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:30.217133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490689b-0349-4821-87a7-7c8d32121b92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:30.218701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490689b-0349-4821-87a7-7c8d32121b92 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:30.228375 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1165/2337] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:13:30.719795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb294c5-2c01-4ad0-8dd2-7fdb9d77ae57 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:30.721567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2cb294c5-2c01-4ad0-8dd2-7fdb9d77ae57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:30.743541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:13:30.752382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb294c5-2c01-4ad0-8dd2-7fdb9d77ae57 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:30.757544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:30.758422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:30.758708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:30.758991 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] PATH_INFO: `/v3/projects/f6bb5b81ef824a7fadf70e45863753a6` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:30.761436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bb5b81ef824a7fadf70e45863753a6)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:30.763400 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:30.869962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bb5b81ef824a7fadf70e45863753a6', 'request_id': 'req-833f5e0c-5222-4e7d-88ed-80bcad271a89'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:30.875629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bb5b81ef824a7fadf70e45863753a6', 'request_id': 'req-833f5e0c-5222-4e7d-88ed-80bcad271a89'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:30.965342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bb5b81ef824a7fadf70e45863753a6', 'request_id': 'req-833f5e0c-5222-4e7d-88ed-80bcad271a89'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:30.977144 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] The token cache is being invalidate because project f6bb5b81ef824a7fadf70e45863753a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:13:30.977436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:30.978082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:13:30.980504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1173/2338] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:13:30 2022] DELETE /identity/v3/projects/f6bb5b81ef824a7fadf70e45863753a6 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:13:31.771166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dc387-9ffe-4d05-a611-6e2ce7942f55 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:31.771714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dc387-9ffe-4d05-a611-6e2ce7942f55 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:31.771714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53dc387-9ffe-4d05-a611-6e2ce7942f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:31.790810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b53dc387-9ffe-4d05-a611-6e2ce7942f55 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:31.792703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b53dc387-9ffe-4d05-a611-6e2ce7942f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:31.857423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1166/2339] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:13:31.873781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:31.875317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:31.952796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833f5e0c-5222-4e7d-88ed-80bcad271a89 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:31.958120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02483-fab5-4300-b6c5-3aa49fb88bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:31.958764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02483-fab5-4300-b6c5-3aa49fb88bab service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:31.959046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02483-fab5-4300-b6c5-3aa49fb88bab service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:31.959316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02483-fab5-4300-b6c5-3aa49fb88bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:31.969352 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02483-fab5-4300-b6c5-3aa49fb88bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:31.970941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02483-fab5-4300-b6c5-3aa49fb88bab service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:31.981310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1174/2340] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:13:36.045718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a5cc0-4501-4cd1-8375-7a41c929ff7f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:36.046268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a5cc0-4501-4cd1-8375-7a41c929ff7f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:36.046378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a5cc0-4501-4cd1-8375-7a41c929ff7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:36.066532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a86a5cc0-4501-4cd1-8375-7a41c929ff7f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:36.067749 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a86a5cc0-4501-4cd1-8375-7a41c929ff7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:36.076685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1167/2341] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:13:36.092989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02483-fab5-4300-b6c5-3aa49fb88bab service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:13:36.104066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02483-fab5-4300-b6c5-3aa49fb88bab service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:13:36.109608 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca5968-eefe-4ae6-9aed-ef293893fcb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:13:36.110236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca5968-eefe-4ae6-9aed-ef293893fcb3 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:36.110521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca5968-eefe-4ae6-9aed-ef293893fcb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:36.110795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca5968-eefe-4ae6-9aed-ef293893fcb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:36.119062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca5968-eefe-4ae6-9aed-ef293893fcb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:13:36.120942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eca5968-eefe-4ae6-9aed-ef293893fcb3 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:13:36.130838 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1175/2342] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:13:46.061110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=51 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:13:46.126108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=66,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:13:54.585643 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77af7-1b04-4cdc-b15b-93205088cf98 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:13:54.586214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77af7-1b04-4cdc-b15b-93205088cf98 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:13:54.586325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af77af7-1b04-4cdc-b15b-93205088cf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:13:54.604581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4af77af7-1b04-4cdc-b15b-93205088cf98 None None] MFA Rules not processed for user `7b2f04953c114350bed092cbc2cdf3ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:13:54.605794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4af77af7-1b04-4cdc-b15b-93205088cf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:13:54.663032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1168/2343] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:13:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:14:04.655768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=25 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:14:13.483657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74f8c7-a5f3-4d2f-900c-d5654004d604 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:13.496039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74f8c7-a5f3-4d2f-900c-d5654004d604 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:13.496039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74f8c7-a5f3-4d2f-900c-d5654004d604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:13.505586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ab74f8c7-a5f3-4d2f-900c-d5654004d604 None None] MFA Rules not processed for user `66801c15461d4b419949b4959805306a`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:14:13.506987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ab74f8c7-a5f3-4d2f-900c-d5654004d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:13.595106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1176/2344] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:14:13 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:14:15.689429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67e99-5cb9-4e69-9708-27b7f292b19e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:15.689986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67e99-5cb9-4e69-9708-27b7f292b19e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:15.689986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc67e99-5cb9-4e69-9708-27b7f292b19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:15.708617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1bc67e99-5cb9-4e69-9708-27b7f292b19e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:14:15.712827 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1bc67e99-5cb9-4e69-9708-27b7f292b19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:15.718956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1169/2345] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:14:15.741277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74f8c7-a5f3-4d2f-900c-d5654004d604 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:14:15.754876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74f8c7-a5f3-4d2f-900c-d5654004d604 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:14:15.761395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd234eae-ea75-4686-b3db-c0b2cd672e80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:14:15.770342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd234eae-ea75-4686-b3db-c0b2cd672e80 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:15.770342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd234eae-ea75-4686-b3db-c0b2cd672e80 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:15.770342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd234eae-ea75-4686-b3db-c0b2cd672e80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:15.771690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd234eae-ea75-4686-b3db-c0b2cd672e80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:14:15.773375 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd234eae-ea75-4686-b3db-c0b2cd672e80 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:14:15.784245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1177/2346] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:14:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:14:23.510695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7557620-d1af-42db-bea3-3406f5a2d19d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:23.511241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7557620-d1af-42db-bea3-3406f5a2d19d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:23.511241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7557620-d1af-42db-bea3-3406f5a2d19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:23.530266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c7557620-d1af-42db-bea3-3406f5a2d19d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:14:23.531494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c7557620-d1af-42db-bea3-3406f5a2d19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:23.539769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1170/2347] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:14:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:14:23.558761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd234eae-ea75-4686-b3db-c0b2cd672e80 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:14:23.570365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd234eae-ea75-4686-b3db-c0b2cd672e80 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:14:23.576143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b8799-f06b-4b63-b1e4-69733c52d137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:14:23.576918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b8799-f06b-4b63-b1e4-69733c52d137 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:23.577266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b8799-f06b-4b63-b1e4-69733c52d137 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:23.577716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b8799-f06b-4b63-b1e4-69733c52d137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:23.588389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b8799-f06b-4b63-b1e4-69733c52d137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:14:23.589988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b8799-f06b-4b63-b1e4-69733c52d137 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:14:23.600240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1178/2348] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:14:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:14:28.328120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec1728-a4fa-417c-8deb-00b2112d4e55 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:28.328120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec1728-a4fa-417c-8deb-00b2112d4e55 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:28.328120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec1728-a4fa-417c-8deb-00b2112d4e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:28.348147 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f5ec1728-a4fa-417c-8deb-00b2112d4e55 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:14:28.349660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f5ec1728-a4fa-417c-8deb-00b2112d4e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:28.359325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1171/2349] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:14:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:14:28.374690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b8799-f06b-4b63-b1e4-69733c52d137 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:14:28.391501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b8799-f06b-4b63-b1e4-69733c52d137 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:14:28.397421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1302db7-1d65-4e1b-a469-0f0e3df46cbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:14:28.398076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1302db7-1d65-4e1b-a469-0f0e3df46cbf service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:28.398362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1302db7-1d65-4e1b-a469-0f0e3df46cbf service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:28.398651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1302db7-1d65-4e1b-a469-0f0e3df46cbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:28.409121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1302db7-1d65-4e1b-a469-0f0e3df46cbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:14:28.410750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1302db7-1d65-4e1b-a469-0f0e3df46cbf service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:14:28.422001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1179/2350] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:14:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:14:29.870738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f1d6a-614b-4139-96a1-2de8480b985b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:29.871265 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f1d6a-614b-4139-96a1-2de8480b985b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:29.871364 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f1d6a-614b-4139-96a1-2de8480b985b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:29.889812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7f3f1d6a-614b-4139-96a1-2de8480b985b None None] MFA Rules not processed for user `8cbac3c664d944788b05516600b7df25`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:14:29.891041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7f3f1d6a-614b-4139-96a1-2de8480b985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:29.952606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1172/2351] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:14:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:14:31.605282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066195b4-4f3f-43ba-9c49-2815f662188d None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:31.606053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066195b4-4f3f-43ba-9c49-2815f662188d None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:31.606217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066195b4-4f3f-43ba-9c49-2815f662188d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:31.626093 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-066195b4-4f3f-43ba-9c49-2815f662188d None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:14:31.627349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-066195b4-4f3f-43ba-9c49-2815f662188d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:31.636350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1180/2352] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:14:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:14:31.652782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f1d6a-614b-4139-96a1-2de8480b985b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:14:31.655838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7f3f1d6a-614b-4139-96a1-2de8480b985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:31.671546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f1d6a-614b-4139-96a1-2de8480b985b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:14:31.677175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6345a37-4e8c-4fa1-87f9-1713a701cdd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:14:31.677842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345a37-4e8c-4fa1-87f9-1713a701cdd3 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:31.679389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345a37-4e8c-4fa1-87f9-1713a701cdd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:31.681904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6345a37-4e8c-4fa1-87f9-1713a701cdd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:31.688840 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6345a37-4e8c-4fa1-87f9-1713a701cdd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:14:31.690444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6345a37-4e8c-4fa1-87f9-1713a701cdd3 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:14:31.701351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1173/2353] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:14:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:14:32.836295 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1d818-bd78-4735-8345-e3f5c4e0a7bf None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:32.836797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1d818-bd78-4735-8345-e3f5c4e0a7bf None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:32.836913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1d818-bd78-4735-8345-e3f5c4e0a7bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:32.854858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-eba1d818-bd78-4735-8345-e3f5c4e0a7bf None None] MFA Rules not processed for user `111b06722ed54bcaab771e4788015cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:14:32.856285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eba1d818-bd78-4735-8345-e3f5c4e0a7bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:32.919353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1181/2354] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:14:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:14:34.882683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80058a5-ab68-4f30-b4f5-b40df0abbf2b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:34.883096 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80058a5-ab68-4f30-b4f5-b40df0abbf2b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:34.883401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80058a5-ab68-4f30-b4f5-b40df0abbf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:34.908436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b80058a5-ab68-4f30-b4f5-b40df0abbf2b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:14:34.908436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b80058a5-ab68-4f30-b4f5-b40df0abbf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:34.914855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1174/2355] 10.222.0.87 () {58 vars in 1016 bytes} [Wed Jul 20 22:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:14:34.932486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1d818-bd78-4735-8345-e3f5c4e0a7bf None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:14:34.946239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1d818-bd78-4735-8345-e3f5c4e0a7bf None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:14:34.952698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2929-a972-45da-8b7c-39946bdc6cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:14:34.953826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2929-a972-45da-8b7c-39946bdc6cdc service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:34.953826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2929-a972-45da-8b7c-39946bdc6cdc service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:34.954064 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2929-a972-45da-8b7c-39946bdc6cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:34.963062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff2929-a972-45da-8b7c-39946bdc6cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:14:34.964964 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff2929-a972-45da-8b7c-39946bdc6cdc service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:14:34.975382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1182/2356] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:14:44.897514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=43 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:14:44.904005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80058a5-ab68-4f30-b4f5-b40df0abbf2b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:14:44.909097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b80058a5-ab68-4f30-b4f5-b40df0abbf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:44.970805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=77 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:14:44.977993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80058a5-ab68-4f30-b4f5-b40df0abbf2b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:14:44.977993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5767a18c-a705-4d31-9778-ead2dbcd2592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:14:44.977993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a18c-a705-4d31-9778-ead2dbcd2592 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:44.977993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a18c-a705-4d31-9778-ead2dbcd2592 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:44.978406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767a18c-a705-4d31-9778-ead2dbcd2592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:44.979052 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5767a18c-a705-4d31-9778-ead2dbcd2592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:44.993410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767a18c-a705-4d31-9778-ead2dbcd2592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:14:44.995021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5767a18c-a705-4d31-9778-ead2dbcd2592 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:14:45.006890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1175/2357] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:14:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:14:47.235111 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2929-a972-45da-8b7c-39946bdc6cdc service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:14:47.245579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2929-a972-45da-8b7c-39946bdc6cdc service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:14:47.249272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bca5b-fb7b-44c1-92ab-9720bf914b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:14:47.249915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bca5b-fb7b-44c1-92ab-9720bf914b37 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:47.250227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bca5b-fb7b-44c1-92ab-9720bf914b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:47.250501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bca5b-fb7b-44c1-92ab-9720bf914b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:47.252323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-983bca5b-fb7b-44c1-92ab-9720bf914b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:47.267361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bca5b-fb7b-44c1-92ab-9720bf914b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:14:47.268830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bca5b-fb7b-44c1-92ab-9720bf914b37 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:14:47.280776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1183/2358] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:14:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:14:55.001238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=26 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:14:56.190285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43217d-e7d5-4438-ac96-b425c737c4c2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:14:56.190933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43217d-e7d5-4438-ac96-b425c737c4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:14:56.190933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43217d-e7d5-4438-ac96-b425c737c4c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:14:56.209424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bd43217d-e7d5-4438-ac96-b425c737c4c2 None None] MFA Rules not processed for user `c1c4f2a6178140858efd4599a3f975d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:14:56.210653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bd43217d-e7d5-4438-ac96-b425c737c4c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:14:56.273820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1176/2359] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:14:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:14:57.276108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:03.636827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bca5b-fb7b-44c1-92ab-9720bf914b37 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:03.648445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bca5b-fb7b-44c1-92ab-9720bf914b37 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:03.654926 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5127e55-0af5-43b0-9008-dae4001209ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:03.655562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5127e55-0af5-43b0-9008-dae4001209ff service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:03.655843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5127e55-0af5-43b0-9008-dae4001209ff service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:03.656155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5127e55-0af5-43b0-9008-dae4001209ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:03.657932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d5127e55-0af5-43b0-9008-dae4001209ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:03.669221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5127e55-0af5-43b0-9008-dae4001209ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:03.670726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5127e55-0af5-43b0-9008-dae4001209ff service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:03.679903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1184/2360] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:03.952947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43217d-e7d5-4438-ac96-b425c737c4c2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:03.967170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43217d-e7d5-4438-ac96-b425c737c4c2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:03.972824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3060765-6d96-4b59-9591-cd640606d675 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:03.973311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3060765-6d96-4b59-9591-cd640606d675 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:03.973596 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3060765-6d96-4b59-9591-cd640606d675 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:03.973877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3060765-6d96-4b59-9591-cd640606d675 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:03.975686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f3060765-6d96-4b59-9591-cd640606d675 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:03.987407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3060765-6d96-4b59-9591-cd640606d675 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:03.989029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3060765-6d96-4b59-9591-cd640606d675 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:03.998911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1177/2361] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:13.134980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5127e55-0af5-43b0-9008-dae4001209ff service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:13.136589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d5127e55-0af5-43b0-9008-dae4001209ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:13.152986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5127e55-0af5-43b0-9008-dae4001209ff service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:13.157683 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:13.159782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:13.159782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:13.159782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] PATH_INFO: `/v3/users/7b2f04953c114350bed092cbc2cdf3ec` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:13.160717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b2f04953c114350bed092cbc2cdf3ec)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:13.162715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:13.402925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b2f04953c114350bed092cbc2cdf3ec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:13.473414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b2f04953c114350bed092cbc2cdf3ec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:13.481529 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b2f04953c114350bed092cbc2cdf3ec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:13.482453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b2f04953c114350bed092cbc2cdf3ec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:13.497246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b2f04953c114350bed092cbc2cdf3ec'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:13.503684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1185/2362] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:15:13 2022] DELETE /identity/v3/users/7b2f04953c114350bed092cbc2cdf3ec => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:13.758066 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3060765-6d96-4b59-9591-cd640606d675 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:13.776692 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3060765-6d96-4b59-9591-cd640606d675 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:13.842232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:13.843443 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:13.843725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:13.844034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] PATH_INFO: `/v3/projects/8ab5175815f046f78309ea93f9100592` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:13.845251 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ab5175815f046f78309ea93f9100592)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:13.847239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:13.987887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ab5175815f046f78309ea93f9100592', 'request_id': 'req-ee57b679-1593-43a6-abbf-3895673e7bfb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:13.994639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ab5175815f046f78309ea93f9100592', 'request_id': 'req-ee57b679-1593-43a6-abbf-3895673e7bfb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:14.090386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ab5175815f046f78309ea93f9100592', 'request_id': 'req-ee57b679-1593-43a6-abbf-3895673e7bfb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:14.102302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] The token cache is being invalidate because project 8ab5175815f046f78309ea93f9100592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:15:14.102851 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:14.104627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:14.105059 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1178/2363] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:15:13 2022] DELETE /identity/v3/projects/8ab5175815f046f78309ea93f9100592 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:23.499954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:23.659490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:23.661062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:23.719212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad9d30-c905-4d57-b1e9-9230a47f09f6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:23.766796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1fa1-705e-4839-b475-958a569c9faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:23.767543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1fa1-705e-4839-b475-958a569c9faf service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:23.767860 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1fa1-705e-4839-b475-958a569c9faf service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:23.768188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1fa1-705e-4839-b475-958a569c9faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:23.769956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b55b1fa1-705e-4839-b475-958a569c9faf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:23.831707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b1fa1-705e-4839-b475-958a569c9faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:23.833177 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b1fa1-705e-4839-b475-958a569c9faf service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:23.843628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1186/2364] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:24.099415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:27.903368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:27.904315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:27.919183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b679-1593-43a6-abbf-3895673e7bfb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:27.923745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:27.924637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:27.924918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:27.925189 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] PATH_INFO: `/v3/users/66801c15461d4b419949b4959805306a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:27.926358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66801c15461d4b419949b4959805306a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:27.928405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:28.150445 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66801c15461d4b419949b4959805306a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:28.163238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66801c15461d4b419949b4959805306a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:28.171984 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66801c15461d4b419949b4959805306a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:28.172888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66801c15461d4b419949b4959805306a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:28.173531 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8010bb60-8b5a-4820-8456-c49e6c31cc84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66801c15461d4b419949b4959805306a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:28.284610 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1179/2365] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:15:27 2022] DELETE /identity/v3/users/66801c15461d4b419949b4959805306a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:28.537995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1fa1-705e-4839-b475-958a569c9faf service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:28.549196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1fa1-705e-4839-b475-958a569c9faf service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:28.608879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:28.609771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:28.614769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:28.614769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] PATH_INFO: `/v3/projects/95b80056fd6a46abb2ebb9a6a3bcb689` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:28.614769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95b80056fd6a46abb2ebb9a6a3bcb689)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:28.614769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:28.622687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:28.722541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95b80056fd6a46abb2ebb9a6a3bcb689', 'request_id': 'req-b49e7b2f-0856-4dc5-b02c-501876cdebc3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:28.728105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95b80056fd6a46abb2ebb9a6a3bcb689', 'request_id': 'req-b49e7b2f-0856-4dc5-b02c-501876cdebc3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:28.801645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95b80056fd6a46abb2ebb9a6a3bcb689', 'request_id': 'req-b49e7b2f-0856-4dc5-b02c-501876cdebc3'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:28.813528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] The token cache is being invalidate because project 95b80056fd6a46abb2ebb9a6a3bcb689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:15:28.813828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:28.814479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b49e7b2f-0856-4dc5-b02c-501876cdebc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:28.816066 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1187/2366] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:15:28 2022] DELETE /identity/v3/projects/95b80056fd6a46abb2ebb9a6a3bcb689 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:28.822502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902bbc-4878-45dc-8653-0b1e55957e91 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:28.822803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902bbc-4878-45dc-8653-0b1e55957e91 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:28.823084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf902bbc-4878-45dc-8653-0b1e55957e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:28.841666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cf902bbc-4878-45dc-8653-0b1e55957e91 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:28.842863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cf902bbc-4878-45dc-8653-0b1e55957e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:28.906421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1180/2367] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:28.913916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9a4d-3cec-4627-bde1-a8734227c1ef None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:28.914210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9a4d-3cec-4627-bde1-a8734227c1ef None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:28.914489 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ee9a4d-3cec-4627-bde1-a8734227c1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:28.933612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d2ee9a4d-3cec-4627-bde1-a8734227c1ef None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:28.934822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d2ee9a4d-3cec-4627-bde1-a8734227c1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:28.942671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1188/2368] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:28.947640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf902bbc-4878-45dc-8653-0b1e55957e91 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:28.957668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf902bbc-4878-45dc-8653-0b1e55957e91 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:28.962391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241368-9965-4aef-a74a-732e3f6f5ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:28.963041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241368-9965-4aef-a74a-732e3f6f5ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:28.963320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241368-9965-4aef-a74a-732e3f6f5ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:28.963594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0241368-9965-4aef-a74a-732e3f6f5ab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:28.964349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0241368-9965-4aef-a74a-732e3f6f5ab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:15:28.964653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0241368-9965-4aef-a74a-732e3f6f5ab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:28.966260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0241368-9965-4aef-a74a-732e3f6f5ab3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:28.978276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1181/2369] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:15:28.982566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9a4d-3cec-4627-bde1-a8734227c1ef None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:28.992402 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ee9a4d-3cec-4627-bde1-a8734227c1ef None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:28.998146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d717d-8083-4ba9-9ad5-81c8edbf489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:28.998793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d717d-8083-4ba9-9ad5-81c8edbf489a admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:28.999073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d717d-8083-4ba9-9ad5-81c8edbf489a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:28.999347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d717d-8083-4ba9-9ad5-81c8edbf489a admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:29.000082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d717d-8083-4ba9-9ad5-81c8edbf489a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:29.001975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9d717d-8083-4ba9-9ad5-81c8edbf489a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:29.089764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1189/2370] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:15:28 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:15:29.093940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241368-9965-4aef-a74a-732e3f6f5ab3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:29.104989 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0241368-9965-4aef-a74a-732e3f6f5ab3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:29.160870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4cef9-9cc4-4bb1-aac2-43a7b3c85f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:29.161533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4cef9-9cc4-4bb1-aac2-43a7b3c85f89 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:29.161819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4cef9-9cc4-4bb1-aac2-43a7b3c85f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:29.162097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b4cef9-9cc4-4bb1-aac2-43a7b3c85f89 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:29.162794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4cef9-9cc4-4bb1-aac2-43a7b3c85f89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:29.165920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b4cef9-9cc4-4bb1-aac2-43a7b3c85f89 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:29.172594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:29.272717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1182/2371] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:15:29 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:15:29.276965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d717d-8083-4ba9-9ad5-81c8edbf489a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:29.287203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9d717d-8083-4ba9-9ad5-81c8edbf489a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:29.292751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf7860-47ee-461b-afff-c31334b4be34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:29.293396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7860-47ee-461b-afff-c31334b4be34 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:29.293677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7860-47ee-461b-afff-c31334b4be34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:29.293945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7860-47ee-461b-afff-c31334b4be34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:29.294687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf7860-47ee-461b-afff-c31334b4be34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:29.296357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf7860-47ee-461b-afff-c31334b4be34 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:29.308684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1190/2372] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:15:29.312799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4cef9-9cc4-4bb1-aac2-43a7b3c85f89 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:29.323303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b4cef9-9cc4-4bb1-aac2-43a7b3c85f89 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:29.327947 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fdf20e-0704-4004-ade6-690f5049c78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:29.328654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf20e-0704-4004-ade6-690f5049c78b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:29.329158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf20e-0704-4004-ade6-690f5049c78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:29.329710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fdf20e-0704-4004-ade6-690f5049c78b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:29.330682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdf20e-0704-4004-ade6-690f5049c78b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:29.332326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fdf20e-0704-4004-ade6-690f5049c78b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:29.343000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1183/2373] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:15:29.347176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf7860-47ee-461b-afff-c31334b4be34 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:29.358150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf7860-47ee-461b-afff-c31334b4be34 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:29.362754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55771547-ac1f-439e-bbdf-d10041933013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:29.363629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771547-ac1f-439e-bbdf-d10041933013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:29.363908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771547-ac1f-439e-bbdf-d10041933013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:29.364210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771547-ac1f-439e-bbdf-d10041933013 admin admin] PATH_INFO: `/v3/projects/596ef0d6d75849ba816376d7ab1f8d57/users/2a845f65dcc04540b1c6e86c2f44ca3a/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:29.379646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55771547-ac1f-439e-bbdf-d10041933013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=596ef0d6d75849ba816376d7ab1f8d57, user_id=2a845f65dcc04540b1c6e86c2f44ca3a, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:29.382371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55771547-ac1f-439e-bbdf-d10041933013 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:29.479014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1191/2374] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:15:29 2022] PUT /identity/v3/projects/596ef0d6d75849ba816376d7ab1f8d57/users/2a845f65dcc04540b1c6e86c2f44ca3a/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:29.489907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8749c-049e-45fb-b0d4-79d997ac57c3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:29.490200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8749c-049e-45fb-b0d4-79d997ac57c3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:29.490477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8749c-049e-45fb-b0d4-79d997ac57c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:29.517594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e0a8749c-049e-45fb-b0d4-79d997ac57c3 None None] MFA Rules not processed for user `2a845f65dcc04540b1c6e86c2f44ca3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:29.518805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e0a8749c-049e-45fb-b0d4-79d997ac57c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:29.584994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1184/2375] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:29.595811 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55771547-ac1f-439e-bbdf-d10041933013 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:29.597638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-55771547-ac1f-439e-bbdf-d10041933013 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:29.655514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55771547-ac1f-439e-bbdf-d10041933013 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:29.659247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6fb0a-693f-49b2-8520-6bd403ea0f89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:29.659887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6fb0a-693f-49b2-8520-6bd403ea0f89 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:29.660199 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6fb0a-693f-49b2-8520-6bd403ea0f89 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:29.660482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6fb0a-693f-49b2-8520-6bd403ea0f89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:29.669788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6fb0a-693f-49b2-8520-6bd403ea0f89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:29.671301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c6fb0a-693f-49b2-8520-6bd403ea0f89 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:29.680767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1192/2376] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:36.527897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8749c-049e-45fb-b0d4-79d997ac57c3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:36.529476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e0a8749c-049e-45fb-b0d4-79d997ac57c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:36.602682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8749c-049e-45fb-b0d4-79d997ac57c3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:36.608103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92afce16-c89e-425f-b359-f91832fffb6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:36.608746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afce16-c89e-425f-b359-f91832fffb6a service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:36.609027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afce16-c89e-425f-b359-f91832fffb6a service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:36.609296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92afce16-c89e-425f-b359-f91832fffb6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:36.611021 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-92afce16-c89e-425f-b359-f91832fffb6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:36.667814 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afce16-c89e-425f-b359-f91832fffb6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:36.669789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92afce16-c89e-425f-b359-f91832fffb6a service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:36.678904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1185/2377] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:39.331968 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6fb0a-693f-49b2-8520-6bd403ea0f89 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:39.394760 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:39.420823 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6fb0a-693f-49b2-8520-6bd403ea0f89 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:39.425605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:39.426594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:39.426961 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:39.427163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] PATH_INFO: `/v3/users/2a845f65dcc04540b1c6e86c2f44ca3a` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:39.428524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a845f65dcc04540b1c6e86c2f44ca3a)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:39.430538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:39.644139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a845f65dcc04540b1c6e86c2f44ca3a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:39.701143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a845f65dcc04540b1c6e86c2f44ca3a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:39.709060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a845f65dcc04540b1c6e86c2f44ca3a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:39.709731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a845f65dcc04540b1c6e86c2f44ca3a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:39.722574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a845f65dcc04540b1c6e86c2f44ca3a'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:39.728524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1193/2378] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:15:39 2022] DELETE /identity/v3/users/2a845f65dcc04540b1c6e86c2f44ca3a => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:39.733433 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187330-240f-4ff8-bbdc-41bbe64815de None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:39.733956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187330-240f-4ff8-bbdc-41bbe64815de None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:39.734054 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8187330-240f-4ff8-bbdc-41bbe64815de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:39.740686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:39.752141 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b8187330-240f-4ff8-bbdc-41bbe64815de None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:39.753382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b8187330-240f-4ff8-bbdc-41bbe64815de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:39.817299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1186/2379] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:39.832557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:39.834053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:39.894701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45e45f8-e0ee-4041-ad81-cb872bc37ad4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:39.898318 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20559959-015e-4d94-af94-b0d21e8388b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:39.899026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20559959-015e-4d94-af94-b0d21e8388b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:39.899309 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20559959-015e-4d94-af94-b0d21e8388b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:39.899618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20559959-015e-4d94-af94-b0d21e8388b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:39.910311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20559959-015e-4d94-af94-b0d21e8388b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:39.911752 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20559959-015e-4d94-af94-b0d21e8388b1 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:39.923024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1194/2380] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:40.397357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187330-240f-4ff8-bbdc-41bbe64815de None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:40.398869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b8187330-240f-4ff8-bbdc-41bbe64815de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:40.411406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8187330-240f-4ff8-bbdc-41bbe64815de None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:40.416337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:40.417274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:40.417562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:40.417858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] PATH_INFO: `/v3/projects/596ef0d6d75849ba816376d7ab1f8d57` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:40.419095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=596ef0d6d75849ba816376d7ab1f8d57)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:40.421063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:40.524652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '596ef0d6d75849ba816376d7ab1f8d57', 'request_id': 'req-3e9af195-7840-4f89-a69b-1d978c39aac4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:40.530861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '596ef0d6d75849ba816376d7ab1f8d57', 'request_id': 'req-3e9af195-7840-4f89-a69b-1d978c39aac4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:40.601608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '596ef0d6d75849ba816376d7ab1f8d57', 'request_id': 'req-3e9af195-7840-4f89-a69b-1d978c39aac4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:40.613119 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] The token cache is being invalidate because project 596ef0d6d75849ba816376d7ab1f8d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:15:40.613409 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:40.614040 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3e9af195-7840-4f89-a69b-1d978c39aac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:40.615575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1187/2381] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:15:40 2022] DELETE /identity/v3/projects/596ef0d6d75849ba816376d7ab1f8d57 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:40.620593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2db07-60af-4508-a153-ed52108a824a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:40.621058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2db07-60af-4508-a153-ed52108a824a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:40.621295 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a2db07-60af-4508-a153-ed52108a824a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:40.639351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-93a2db07-60af-4508-a153-ed52108a824a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:40.640629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-93a2db07-60af-4508-a153-ed52108a824a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:40.691966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:40.702466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1195/2382] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:40.710520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83289-8d6e-43f7-9b21-606e913197a7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:40.710810 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83289-8d6e-43f7-9b21-606e913197a7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:40.711110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b83289-8d6e-43f7-9b21-606e913197a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:40.730314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-96b83289-8d6e-43f7-9b21-606e913197a7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:40.731521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-96b83289-8d6e-43f7-9b21-606e913197a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:40.739879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1188/2383] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:40.743761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2db07-60af-4508-a153-ed52108a824a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:40.753928 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a2db07-60af-4508-a153-ed52108a824a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:40.758614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20d215-7d48-4290-a568-e708488b2286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:40.759324 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20d215-7d48-4290-a568-e708488b2286 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:40.759605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20d215-7d48-4290-a568-e708488b2286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:40.759881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a20d215-7d48-4290-a568-e708488b2286 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:40.761210 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20d215-7d48-4290-a568-e708488b2286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:15:40.761541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20d215-7d48-4290-a568-e708488b2286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:40.763165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a20d215-7d48-4290-a568-e708488b2286 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:40.776274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1196/2384] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:15:40.781327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b83289-8d6e-43f7-9b21-606e913197a7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:40.795417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b83289-8d6e-43f7-9b21-606e913197a7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:40.800579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00716f-d1d2-431e-8421-66128ce830c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:40.801245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00716f-d1d2-431e-8421-66128ce830c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:40.801532 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00716f-d1d2-431e-8421-66128ce830c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:40.801813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00716f-d1d2-431e-8421-66128ce830c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:40.802522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00716f-d1d2-431e-8421-66128ce830c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:40.804505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00716f-d1d2-431e-8421-66128ce830c3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:40.920845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1189/2385] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:15:40 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:15:40.925033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20d215-7d48-4290-a568-e708488b2286 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:40.936196 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a20d215-7d48-4290-a568-e708488b2286 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:40.994412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a40031-bfbd-4e59-95c1-5e518227c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:40.995707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a40031-bfbd-4e59-95c1-5e518227c0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:40.996207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a40031-bfbd-4e59-95c1-5e518227c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:40.996490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a40031-bfbd-4e59-95c1-5e518227c0d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:40.997194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a40031-bfbd-4e59-95c1-5e518227c0d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:40.999135 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a40031-bfbd-4e59-95c1-5e518227c0d9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:41.117014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1197/2386] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:15:40 2022] POST /identity/v3/users => generated 287 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:15:41.121386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00716f-d1d2-431e-8421-66128ce830c3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:41.131817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00716f-d1d2-431e-8421-66128ce830c3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:41.137529 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb088ad7-f656-4f69-893c-5428b40bba2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:41.138321 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb088ad7-f656-4f69-893c-5428b40bba2f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:41.138605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb088ad7-f656-4f69-893c-5428b40bba2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:41.138883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb088ad7-f656-4f69-893c-5428b40bba2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:41.139621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb088ad7-f656-4f69-893c-5428b40bba2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:41.141269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb088ad7-f656-4f69-893c-5428b40bba2f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:41.152490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1190/2387] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:15:41.156528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a40031-bfbd-4e59-95c1-5e518227c0d9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:41.167208 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a40031-bfbd-4e59-95c1-5e518227c0d9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:41.173399 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a8725-5728-4f1e-89e6-83e208de6d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:41.174003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a8725-5728-4f1e-89e6-83e208de6d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:41.174288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a8725-5728-4f1e-89e6-83e208de6d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:41.174563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a8725-5728-4f1e-89e6-83e208de6d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:41.175299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a8725-5728-4f1e-89e6-83e208de6d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:41.176929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a8725-5728-4f1e-89e6-83e208de6d5f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:41.189033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1198/2388] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:15:41.193039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb088ad7-f656-4f69-893c-5428b40bba2f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:41.203842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb088ad7-f656-4f69-893c-5428b40bba2f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:41.208678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aac1f5-a705-4c27-a906-7725ee1f0e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:41.209539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aac1f5-a705-4c27-a906-7725ee1f0e78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:41.209817 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aac1f5-a705-4c27-a906-7725ee1f0e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:41.210085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aac1f5-a705-4c27-a906-7725ee1f0e78 admin admin] PATH_INFO: `/v3/projects/2a6ada4781ab46b3ab73e522660d65be/users/d5bbc6fec7a545d98bb2d94459266081/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:41.224196 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aac1f5-a705-4c27-a906-7725ee1f0e78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a6ada4781ab46b3ab73e522660d65be, user_id=d5bbc6fec7a545d98bb2d94459266081, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:41.226826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aac1f5-a705-4c27-a906-7725ee1f0e78 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:41.293846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1191/2389] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:15:41 2022] PUT /identity/v3/projects/2a6ada4781ab46b3ab73e522660d65be/users/d5bbc6fec7a545d98bb2d94459266081/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:41.308689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1740cd-8d7e-457e-b4cc-0a615cca9e8f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:41.308981 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1740cd-8d7e-457e-b4cc-0a615cca9e8f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:41.309260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1740cd-8d7e-457e-b4cc-0a615cca9e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:41.336458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3f1740cd-8d7e-457e-b4cc-0a615cca9e8f None None] MFA Rules not processed for user `d5bbc6fec7a545d98bb2d94459266081`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:41.337680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3f1740cd-8d7e-457e-b4cc-0a615cca9e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:41.402053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1199/2390] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:41.413182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aac1f5-a705-4c27-a906-7725ee1f0e78 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:41.414922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-91aac1f5-a705-4c27-a906-7725ee1f0e78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:41.444728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:41.490894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aac1f5-a705-4c27-a906-7725ee1f0e78 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:41.497762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3e6d8-8712-4de2-a6ab-dd0e97dc6796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:41.498461 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e6d8-8712-4de2-a6ab-dd0e97dc6796 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:41.498813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e6d8-8712-4de2-a6ab-dd0e97dc6796 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:41.499136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3e6d8-8712-4de2-a6ab-dd0e97dc6796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:41.507823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3e6d8-8712-4de2-a6ab-dd0e97dc6796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:41.509581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3e6d8-8712-4de2-a6ab-dd0e97dc6796 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:41.518560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1192/2391] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:41.738324 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1740cd-8d7e-457e-b4cc-0a615cca9e8f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:41.792839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:41.803549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1740cd-8d7e-457e-b4cc-0a615cca9e8f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:41.808529 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:41.809431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:41.814326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:41.814326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] PATH_INFO: `/v3/users/d5bbc6fec7a545d98bb2d94459266081` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:41.814326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5bbc6fec7a545d98bb2d94459266081)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:41.814326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:42.057785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5bbc6fec7a545d98bb2d94459266081'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:42.130493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5bbc6fec7a545d98bb2d94459266081'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:42.139213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5bbc6fec7a545d98bb2d94459266081'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:42.142499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5bbc6fec7a545d98bb2d94459266081'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:42.156363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5bbc6fec7a545d98bb2d94459266081'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:42.162391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1200/2392] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:15:41 2022] DELETE /identity/v3/users/d5bbc6fec7a545d98bb2d94459266081 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:42.167977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac171-7f51-4877-b2c2-439f5e494e12 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:42.168503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac171-7f51-4877-b2c2-439f5e494e12 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:42.168503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ac171-7f51-4877-b2c2-439f5e494e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:42.187104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-303ac171-7f51-4877-b2c2-439f5e494e12 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:42.188363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-303ac171-7f51-4877-b2c2-439f5e494e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:42.252734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1193/2393] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:15:42.262743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:42.264234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:42.333722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45ca7b7-eb59-47e8-9b80-33f407242f5f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:42.337574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac3ca3-af2a-43a0-a3fd-7704a1ac7d12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:42.338224 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac3ca3-af2a-43a0-a3fd-7704a1ac7d12 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:42.338500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac3ca3-af2a-43a0-a3fd-7704a1ac7d12 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:42.339499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac3ca3-af2a-43a0-a3fd-7704a1ac7d12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:42.349484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac3ca3-af2a-43a0-a3fd-7704a1ac7d12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:42.350916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac3ca3-af2a-43a0-a3fd-7704a1ac7d12 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:42.361457 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1201/2394] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:42.774700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac171-7f51-4877-b2c2-439f5e494e12 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:42.777172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-303ac171-7f51-4877-b2c2-439f5e494e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:42.789663 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ac171-7f51-4877-b2c2-439f5e494e12 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:42.795166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:42.796089 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:42.796379 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:42.796655 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] PATH_INFO: `/v3/projects/2a6ada4781ab46b3ab73e522660d65be` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:42.797852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a6ada4781ab46b3ab73e522660d65be)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:42.799858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:42.927571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a6ada4781ab46b3ab73e522660d65be', 'request_id': 'req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:42.933042 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a6ada4781ab46b3ab73e522660d65be', 'request_id': 'req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:43.038275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a6ada4781ab46b3ab73e522660d65be', 'request_id': 'req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:43.050629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] The token cache is being invalidate because project 2a6ada4781ab46b3ab73e522660d65be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:15:43.050917 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:43.051573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ebdf554d-b093-4ccc-a7ef-06323c8f8a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:15:43.053157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1194/2395] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:15:42 2022] DELETE /identity/v3/projects/2a6ada4781ab46b3ab73e522660d65be => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:43.058606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9f5b5-3c44-47bb-9c2c-9281349375bb None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:43.059065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9f5b5-3c44-47bb-9c2c-9281349375bb None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:43.059186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9f5b5-3c44-47bb-9c2c-9281349375bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:43.077829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a2a9f5b5-3c44-47bb-9c2c-9281349375bb None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:43.079058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a2a9f5b5-3c44-47bb-9c2c-9281349375bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:43.136796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1202/2396] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:43.144511 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b6d2b-3366-44ee-9bdb-392e3925cf15 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:43.144802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b6d2b-3366-44ee-9bdb-392e3925cf15 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:43.145082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9b6d2b-3366-44ee-9bdb-392e3925cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:43.164286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ac9b6d2b-3366-44ee-9bdb-392e3925cf15 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:43.165744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ac9b6d2b-3366-44ee-9bdb-392e3925cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:43.173739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1195/2397] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:43.177950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9f5b5-3c44-47bb-9c2c-9281349375bb None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:43.188341 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9f5b5-3c44-47bb-9c2c-9281349375bb None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:43.193422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac0c72-16db-463a-b875-a2950495a0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:43.193924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac0c72-16db-463a-b875-a2950495a0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:43.194217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac0c72-16db-463a-b875-a2950495a0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:43.194494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bac0c72-16db-463a-b875-a2950495a0c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:43.195253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac0c72-16db-463a-b875-a2950495a0c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:15:43.195566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac0c72-16db-463a-b875-a2950495a0c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:43.197278 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bac0c72-16db-463a-b875-a2950495a0c6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:43.210605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1203/2398] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:15:43.215309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b6d2b-3366-44ee-9bdb-392e3925cf15 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:43.224661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9b6d2b-3366-44ee-9bdb-392e3925cf15 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:43.237036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a459aa-c7be-400f-b441-78c6cc94e471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:43.237788 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a459aa-c7be-400f-b441-78c6cc94e471 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:43.238145 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a459aa-c7be-400f-b441-78c6cc94e471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:43.238493 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a459aa-c7be-400f-b441-78c6cc94e471 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:43.239531 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a459aa-c7be-400f-b441-78c6cc94e471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:43.241363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a459aa-c7be-400f-b441-78c6cc94e471 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:43.348503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1196/2399] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:15:43 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:15:43.352873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac0c72-16db-463a-b875-a2950495a0c6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:43.358260 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:43.363588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bac0c72-16db-463a-b875-a2950495a0c6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:43.422770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909775df-55d9-46e1-a3e6-9750f3e6e36b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:43.423434 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909775df-55d9-46e1-a3e6-9750f3e6e36b admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:43.423837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909775df-55d9-46e1-a3e6-9750f3e6e36b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:43.424149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909775df-55d9-46e1-a3e6-9750f3e6e36b admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:43.424839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909775df-55d9-46e1-a3e6-9750f3e6e36b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:43.426851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909775df-55d9-46e1-a3e6-9750f3e6e36b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:43.572723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1204/2400] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:15:43 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:15:43.575439 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a459aa-c7be-400f-b441-78c6cc94e471 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:43.582792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:43.586324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a459aa-c7be-400f-b441-78c6cc94e471 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:43.591664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4e3a-e7bb-4561-91aa-fffeb4cf74c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:43.592430 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4e3a-e7bb-4561-91aa-fffeb4cf74c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:43.592799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4e3a-e7bb-4561-91aa-fffeb4cf74c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:43.593152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fe4e3a-e7bb-4561-91aa-fffeb4cf74c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:43.593942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe4e3a-e7bb-4561-91aa-fffeb4cf74c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:43.595615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fe4e3a-e7bb-4561-91aa-fffeb4cf74c3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:43.607463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1197/2401] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:15:43.611831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909775df-55d9-46e1-a3e6-9750f3e6e36b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:43.623432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909775df-55d9-46e1-a3e6-9750f3e6e36b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:43.628062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fc1fc-9fea-4945-8944-7266917286b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:43.628716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fc1fc-9fea-4945-8944-7266917286b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:43.628998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fc1fc-9fea-4945-8944-7266917286b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:43.629269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fc1fc-9fea-4945-8944-7266917286b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:43.630001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fc1fc-9fea-4945-8944-7266917286b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:43.631613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fc1fc-9fea-4945-8944-7266917286b0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:43.644003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1205/2402] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:15:43.647980 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4e3a-e7bb-4561-91aa-fffeb4cf74c3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:43.657999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fe4e3a-e7bb-4561-91aa-fffeb4cf74c3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:43.662453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668e0ea-7238-43ab-80be-069519d89ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:43.663367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668e0ea-7238-43ab-80be-069519d89ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:43.663681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668e0ea-7238-43ab-80be-069519d89ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:43.663988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a668e0ea-7238-43ab-80be-069519d89ce7 admin admin] PATH_INFO: `/v3/projects/1dc4da3874d146aba8ac11f560836124/users/4abf61cf4ad74deca8b820851e4a0fbf/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:43.678870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668e0ea-7238-43ab-80be-069519d89ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc4da3874d146aba8ac11f560836124, user_id=4abf61cf4ad74deca8b820851e4a0fbf, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:43.681554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a668e0ea-7238-43ab-80be-069519d89ce7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:43.799654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1198/2403] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:15:43 2022] PUT /identity/v3/projects/1dc4da3874d146aba8ac11f560836124/users/4abf61cf4ad74deca8b820851e4a0fbf/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:43.811444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e32250-f918-4298-af10-836fd9cc515b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:43.811739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e32250-f918-4298-af10-836fd9cc515b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:43.812057 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e32250-f918-4298-af10-836fd9cc515b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:43.841334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-e1e32250-f918-4298-af10-836fd9cc515b None None] MFA Rules not processed for user `4abf61cf4ad74deca8b820851e4a0fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:43.842596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e1e32250-f918-4298-af10-836fd9cc515b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:43.907445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1206/2404] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:43.912056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668e0ea-7238-43ab-80be-069519d89ce7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:43.975297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a668e0ea-7238-43ab-80be-069519d89ce7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:43.980671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47660e-a6e1-41d6-9705-1c10ceba9a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:43.981325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47660e-a6e1-41d6-9705-1c10ceba9a54 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:43.981606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47660e-a6e1-41d6-9705-1c10ceba9a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:43.981880 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47660e-a6e1-41d6-9705-1c10ceba9a54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:43.982571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47660e-a6e1-41d6-9705-1c10ceba9a54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:43.984518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc47660e-a6e1-41d6-9705-1c10ceba9a54 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:44.085281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1199/2405] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:15:43 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:15:44.089953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e32250-f918-4298-af10-836fd9cc515b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:44.100596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e32250-f918-4298-af10-836fd9cc515b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:44.159562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae2233-91f6-46f1-9e3d-89438e166eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:44.160316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2233-91f6-46f1-9e3d-89438e166eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:44.160603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2233-91f6-46f1-9e3d-89438e166eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:44.160879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ae2233-91f6-46f1-9e3d-89438e166eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:44.161567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae2233-91f6-46f1-9e3d-89438e166eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:44.163545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ae2233-91f6-46f1-9e3d-89438e166eb3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:44.273786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:44.282745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1207/2406] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:15:44 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:15:44.290969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47660e-a6e1-41d6-9705-1c10ceba9a54 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:44.295734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc47660e-a6e1-41d6-9705-1c10ceba9a54 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:44.300716 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842caefe-3500-4ba7-92a2-e1e2f19d53df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:44.301388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842caefe-3500-4ba7-92a2-e1e2f19d53df admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:44.301973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842caefe-3500-4ba7-92a2-e1e2f19d53df admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:44.302076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842caefe-3500-4ba7-92a2-e1e2f19d53df admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:44.302776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842caefe-3500-4ba7-92a2-e1e2f19d53df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:44.304425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842caefe-3500-4ba7-92a2-e1e2f19d53df admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:44.315490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1200/2407] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:15:44.327258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae2233-91f6-46f1-9e3d-89438e166eb3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:44.337508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ae2233-91f6-46f1-9e3d-89438e166eb3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:44.343008 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72905-a412-4427-8648-5832bb5b65fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:44.344170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72905-a412-4427-8648-5832bb5b65fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:44.344648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72905-a412-4427-8648-5832bb5b65fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:44.345335 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df72905-a412-4427-8648-5832bb5b65fb admin admin] PATH_INFO: `/v3/projects/bef8c4e4318a46bda200a086f8df5ff8/users/b18e27f0fa0c4df9961719d1631a698d/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:44.360525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df72905-a412-4427-8648-5832bb5b65fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef8c4e4318a46bda200a086f8df5ff8, user_id=b18e27f0fa0c4df9961719d1631a698d, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:44.363235 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df72905-a412-4427-8648-5832bb5b65fb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:44.495289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1208/2408] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:15:44 2022] PUT /identity/v3/projects/bef8c4e4318a46bda200a086f8df5ff8/users/b18e27f0fa0c4df9961719d1631a698d/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:44.499695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842caefe-3500-4ba7-92a2-e1e2f19d53df admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:44.509963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842caefe-3500-4ba7-92a2-e1e2f19d53df admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:44.567682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9549956-b9b9-457a-b967-e548845b81ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:44.568317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549956-b9b9-457a-b967-e548845b81ac admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:44.568604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549956-b9b9-457a-b967-e548845b81ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:44.568879 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9549956-b9b9-457a-b967-e548845b81ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:44.569611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9549956-b9b9-457a-b967-e548845b81ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:44.571450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9549956-b9b9-457a-b967-e548845b81ac admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:44.583063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1201/2409] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:15:44.587283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72905-a412-4427-8648-5832bb5b65fb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:44.599478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df72905-a412-4427-8648-5832bb5b65fb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:44.603074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5eaa8-8664-4467-9510-a8e445d6631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:44.604016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5eaa8-8664-4467-9510-a8e445d6631c admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:44.604334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5eaa8-8664-4467-9510-a8e445d6631c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:44.604615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b5eaa8-8664-4467-9510-a8e445d6631c admin admin] PATH_INFO: `/v3/projects/bef8c4e4318a46bda200a086f8df5ff8/users/b18e27f0fa0c4df9961719d1631a698d/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:44.606627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5eaa8-8664-4467-9510-a8e445d6631c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bef8c4e4318a46bda200a086f8df5ff8, user_id=b18e27f0fa0c4df9961719d1631a698d, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:44.609327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b5eaa8-8664-4467-9510-a8e445d6631c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:44.620975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1209/2410] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:15:44 2022] PUT /identity/v3/projects/bef8c4e4318a46bda200a086f8df5ff8/users/b18e27f0fa0c4df9961719d1631a698d/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:15:44.632730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ddc90-83b3-4ace-b054-ef132823da7b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:44.633041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ddc90-83b3-4ace-b054-ef132823da7b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:44.633320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ddc90-83b3-4ace-b054-ef132823da7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:44.662861 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9a7ddc90-83b3-4ace-b054-ef132823da7b None None] MFA Rules not processed for user `b18e27f0fa0c4df9961719d1631a698d`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:44.664164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9a7ddc90-83b3-4ace-b054-ef132823da7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:44.695907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:44.739153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1202/2411] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:44.750881 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5eaa8-8664-4467-9510-a8e445d6631c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:44.752683 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-93b5eaa8-8664-4467-9510-a8e445d6631c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:44.812163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b5eaa8-8664-4467-9510-a8e445d6631c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:44.815840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c11fa-8e3b-4a83-b0ca-8d411f10b7b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:44.816521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c11fa-8e3b-4a83-b0ca-8d411f10b7b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:44.816804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c11fa-8e3b-4a83-b0ca-8d411f10b7b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:44.817081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c11fa-8e3b-4a83-b0ca-8d411f10b7b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:44.827729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c11fa-8e3b-4a83-b0ca-8d411f10b7b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:44.829207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c11fa-8e3b-4a83-b0ca-8d411f10b7b2 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:44.838921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1210/2412] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:45.050111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ddc90-83b3-4ace-b054-ef132823da7b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:45.062034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ddc90-83b3-4ace-b054-ef132823da7b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:45.065835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6263e-2ed5-490e-9d95-b9ca26515378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:45.066957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6263e-2ed5-490e-9d95-b9ca26515378 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:45.066957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6263e-2ed5-490e-9d95-b9ca26515378 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:45.067141 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d6263e-2ed5-490e-9d95-b9ca26515378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:45.125530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6263e-2ed5-490e-9d95-b9ca26515378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:45.126981 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d6263e-2ed5-490e-9d95-b9ca26515378 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:45.136253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1203/2413] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:51.485272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c11fa-8e3b-4a83-b0ca-8d411f10b7b2 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:51.486723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f44c11fa-8e3b-4a83-b0ca-8d411f10b7b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:51.641588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c11fa-8e3b-4a83-b0ca-8d411f10b7b2 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:51.649448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d554deef-f7b3-4d66-9426-d93936d7cd2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:51.650459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554deef-f7b3-4d66-9426-d93936d7cd2e service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:51.662300 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554deef-f7b3-4d66-9426-d93936d7cd2e service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:51.662300 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d554deef-f7b3-4d66-9426-d93936d7cd2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:51.669422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d554deef-f7b3-4d66-9426-d93936d7cd2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:51.686184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554deef-f7b3-4d66-9426-d93936d7cd2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:51.687803 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d554deef-f7b3-4d66-9426-d93936d7cd2e service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:51.702523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1211/2414] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:55.132047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=44 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:56.824418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6263e-2ed5-490e-9d95-b9ca26515378 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:56.830278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b2d6263e-2ed5-490e-9d95-b9ca26515378 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:56.960274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d6263e-2ed5-490e-9d95-b9ca26515378 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:56.965317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a4221-7c84-48bd-94af-b54a8f5d8d68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:56.968008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a4221-7c84-48bd-94af-b54a8f5d8d68 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:56.968008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a4221-7c84-48bd-94af-b54a8f5d8d68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:56.968008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a4221-7c84-48bd-94af-b54a8f5d8d68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:56.968687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cd2a4221-7c84-48bd-94af-b54a8f5d8d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:56.980678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a4221-7c84-48bd-94af-b54a8f5d8d68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:56.982676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a4221-7c84-48bd-94af-b54a8f5d8d68 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:56.992595 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1204/2415] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:15:58.136761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5d92b-8e29-4d80-ac04-57b807ef0cfd None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:58.137290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5d92b-8e29-4d80-ac04-57b807ef0cfd None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:58.137290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a5d92b-8e29-4d80-ac04-57b807ef0cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:58.143174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:58.155323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-60a5d92b-8e29-4d80-ac04-57b807ef0cfd None None] MFA Rules not processed for user `111b06722ed54bcaab771e4788015cb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:58.161416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-60a5d92b-8e29-4d80-ac04-57b807ef0cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:58.212571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1212/2416] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:15:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:58.516269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a4221-7c84-48bd-94af-b54a8f5d8d68 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:58.517617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cd2a4221-7c84-48bd-94af-b54a8f5d8d68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:58.528910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a4221-7c84-48bd-94af-b54a8f5d8d68 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:58.532497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05746aa7-0c4c-4399-a92a-5ad5db16e046 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:58.533126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746aa7-0c4c-4399-a92a-5ad5db16e046 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:58.533406 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746aa7-0c4c-4399-a92a-5ad5db16e046 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:58.533690 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05746aa7-0c4c-4399-a92a-5ad5db16e046 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:58.535776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-05746aa7-0c4c-4399-a92a-5ad5db16e046 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:58.546440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05746aa7-0c4c-4399-a92a-5ad5db16e046 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:58.548015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05746aa7-0c4c-4399-a92a-5ad5db16e046 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:58.557085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1205/2417] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:59.032931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5d92b-8e29-4d80-ac04-57b807ef0cfd None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:59.034519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-60a5d92b-8e29-4d80-ac04-57b807ef0cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:59.129943 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a5d92b-8e29-4d80-ac04-57b807ef0cfd None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:59.135294 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56e4c2-ab3c-401f-bf55-d1fa39b65d8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e52a3464d8f4a3fa16a102336a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:59.136253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56e4c2-ab3c-401f-bf55-d1fa39b65d8a service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:59.136603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56e4c2-ab3c-401f-bf55-d1fa39b65d8a service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:59.136975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56e4c2-ab3c-401f-bf55-d1fa39b65d8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:59.138879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf56e4c2-ab3c-401f-bf55-d1fa39b65d8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:59.151712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56e4c2-ab3c-401f-bf55-d1fa39b65d8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:59.153533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf56e4c2-ab3c-401f-bf55-d1fa39b65d8a service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:59.163992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1213/2418] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:59.200345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68567-288d-4312-9558-1a8c0e3fa606 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:59.200638 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68567-288d-4312-9558-1a8c0e3fa606 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:59.200918 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a68567-288d-4312-9558-1a8c0e3fa606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:59.231178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-34a68567-288d-4312-9558-1a8c0e3fa606 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:15:59.232653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-34a68567-288d-4312-9558-1a8c0e3fa606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:59.299910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1206/2419] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:15:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:15:59.536055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56e4c2-ab3c-401f-bf55-d1fa39b65d8a service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:59.537988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-bf56e4c2-ab3c-401f-bf55-d1fa39b65d8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:59.553797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf56e4c2-ab3c-401f-bf55-d1fa39b65d8a service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:59.560226 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c492a38f-f428-43b3-bd8f-5c1d298af94e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:59.560865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492a38f-f428-43b3-bd8f-5c1d298af94e service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:59.561149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492a38f-f428-43b3-bd8f-5c1d298af94e service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:59.561420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c492a38f-f428-43b3-bd8f-5c1d298af94e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:59.563178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c492a38f-f428-43b3-bd8f-5c1d298af94e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:59.576001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492a38f-f428-43b3-bd8f-5c1d298af94e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:59.577563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c492a38f-f428-43b3-bd8f-5c1d298af94e service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:59.588252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1214/2420] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:15:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:15:59.617182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68567-288d-4312-9558-1a8c0e3fa606 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:15:59.618786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-34a68567-288d-4312-9558-1a8c0e3fa606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:15:59.679210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:15:59.698919 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a68567-288d-4312-9558-1a8c0e3fa606 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:15:59.704082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15967691-72c2-45a8-baaa-738c30b92c63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:15:59.704764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15967691-72c2-45a8-baaa-738c30b92c63 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:15:59.705043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15967691-72c2-45a8-baaa-738c30b92c63 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:15:59.705318 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15967691-72c2-45a8-baaa-738c30b92c63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:15:59.714516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15967691-72c2-45a8-baaa-738c30b92c63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:15:59.716131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15967691-72c2-45a8-baaa-738c30b92c63 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:15:59.724614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1207/2421] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:15:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:16:09.583600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=62 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:09.857239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:23.043483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edfccc-ab90-48f7-9e08-15323f909b81 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:23.044445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edfccc-ab90-48f7-9e08-15323f909b81 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:23.045174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73edfccc-ab90-48f7-9e08-15323f909b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:23.082852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-73edfccc-ab90-48f7-9e08-15323f909b81 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:23.084499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-73edfccc-ab90-48f7-9e08-15323f909b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:23.093795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1215/2422] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:16:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:23.107076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15967691-72c2-45a8-baaa-738c30b92c63 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:23.119334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15967691-72c2-45a8-baaa-738c30b92c63 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:23.124769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3f17f-d4e1-477e-a5a6-c651039a79e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:23.125488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3f17f-d4e1-477e-a5a6-c651039a79e5 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:23.125773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3f17f-d4e1-477e-a5a6-c651039a79e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:23.126047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3f17f-d4e1-477e-a5a6-c651039a79e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:23.138195 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3f17f-d4e1-477e-a5a6-c651039a79e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:23.145440 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3f17f-d4e1-477e-a5a6-c651039a79e5 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:23.156131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1208/2423] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:16:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:16:23.398321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edfccc-ab90-48f7-9e08-15323f909b81 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:23.575069 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73edfccc-ab90-48f7-9e08-15323f909b81 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:23.581729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:23.582691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:23.583024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:23.583307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] PATH_INFO: `/v3/users/4abf61cf4ad74deca8b820851e4a0fbf` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:23.584682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abf61cf4ad74deca8b820851e4a0fbf)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:23.586814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:23.797843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abf61cf4ad74deca8b820851e4a0fbf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:23.887105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abf61cf4ad74deca8b820851e4a0fbf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:23.895720 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abf61cf4ad74deca8b820851e4a0fbf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:23.896557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abf61cf4ad74deca8b820851e4a0fbf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:23.914522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abf61cf4ad74deca8b820851e4a0fbf'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:23.925522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1216/2424] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:23 2022] DELETE /identity/v3/users/4abf61cf4ad74deca8b820851e4a0fbf => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:23.929917 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fddcf-d8ea-4642-b9af-7bf9c5e82770 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:23.930277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fddcf-d8ea-4642-b9af-7bf9c5e82770 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:23.930557 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fddcf-d8ea-4642-b9af-7bf9c5e82770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:23.990323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2d5fddcf-d8ea-4642-b9af-7bf9c5e82770 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:23.991758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2d5fddcf-d8ea-4642-b9af-7bf9c5e82770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:24.087967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1209/2425] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:24.097459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:24.098920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:24.197911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c36f6-2a1e-4bf5-87f3-7e5c52d9447e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:24.202325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28762d52-df35-4d26-b5f5-ed4de9d430ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:24.203059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28762d52-df35-4d26-b5f5-ed4de9d430ee service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:24.203405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28762d52-df35-4d26-b5f5-ed4de9d430ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:24.203842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28762d52-df35-4d26-b5f5-ed4de9d430ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:24.214736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28762d52-df35-4d26-b5f5-ed4de9d430ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:24.216220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28762d52-df35-4d26-b5f5-ed4de9d430ee service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:24.220567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:24.229668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1217/2426] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:24.722450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fddcf-d8ea-4642-b9af-7bf9c5e82770 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:24.722450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2d5fddcf-d8ea-4642-b9af-7bf9c5e82770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:24.742455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fddcf-d8ea-4642-b9af-7bf9c5e82770 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:24.756173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:24.757143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:24.757455 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:24.757734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] PATH_INFO: `/v3/projects/1dc4da3874d146aba8ac11f560836124` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:24.766722 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc4da3874d146aba8ac11f560836124)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:24.766722 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:24.891880 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc4da3874d146aba8ac11f560836124', 'request_id': 'req-8bc99307-6aad-4016-ae3d-584e28225826'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:24.905114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc4da3874d146aba8ac11f560836124', 'request_id': 'req-8bc99307-6aad-4016-ae3d-584e28225826'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:25.027352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc4da3874d146aba8ac11f560836124', 'request_id': 'req-8bc99307-6aad-4016-ae3d-584e28225826'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:25.040229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] The token cache is being invalidate because project 1dc4da3874d146aba8ac11f560836124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:25.044135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:25.044135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:25.044135 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1210/2427] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:24 2022] DELETE /identity/v3/projects/1dc4da3874d146aba8ac11f560836124 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:25.047307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28762d52-df35-4d26-b5f5-ed4de9d430ee service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:25.057729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28762d52-df35-4d26-b5f5-ed4de9d430ee service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:25.138531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:25.139476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:25.139977 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:25.140327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] PATH_INFO: `/v3/users/b18e27f0fa0c4df9961719d1631a698d` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:25.141707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b18e27f0fa0c4df9961719d1631a698d)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:25.153186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:25.394142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b18e27f0fa0c4df9961719d1631a698d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:25.521354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b18e27f0fa0c4df9961719d1631a698d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:25.531615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b18e27f0fa0c4df9961719d1631a698d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:25.532472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b18e27f0fa0c4df9961719d1631a698d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:25.547034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9efef7e6-f550-4c24-b951-f76d4c64a1cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b18e27f0fa0c4df9961719d1631a698d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:25.553225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1218/2428] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:25 2022] DELETE /identity/v3/users/b18e27f0fa0c4df9961719d1631a698d => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:26.155702 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:26.157325 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:26.205637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc99307-6aad-4016-ae3d-584e28225826 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:26.273390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:26.284331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:26.285358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:26.285724 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:26.286140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] PATH_INFO: `/v3/projects/bef8c4e4318a46bda200a086f8df5ff8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:26.287373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bef8c4e4318a46bda200a086f8df5ff8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:26.289351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:26.404015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bef8c4e4318a46bda200a086f8df5ff8', 'request_id': 'req-80b6a85e-3721-4f61-a61b-b9e4fe43a804'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:26.410631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bef8c4e4318a46bda200a086f8df5ff8', 'request_id': 'req-80b6a85e-3721-4f61-a61b-b9e4fe43a804'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:26.508078 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bef8c4e4318a46bda200a086f8df5ff8', 'request_id': 'req-80b6a85e-3721-4f61-a61b-b9e4fe43a804'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:26.518097 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] The token cache is being invalidate because project bef8c4e4318a46bda200a086f8df5ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:26.518583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:26.520226 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-80b6a85e-3721-4f61-a61b-b9e4fe43a804 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:26.521950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1211/2429] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:26 2022] DELETE /identity/v3/projects/bef8c4e4318a46bda200a086f8df5ff8 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:26.529056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aca77-5943-4604-927c-d055e41e3a90 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:26.529550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aca77-5943-4604-927c-d055e41e3a90 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:26.529901 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982aca77-5943-4604-927c-d055e41e3a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:26.614958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-982aca77-5943-4604-927c-d055e41e3a90 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:26.616492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-982aca77-5943-4604-927c-d055e41e3a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:26.690575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:26.712367 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1219/2430] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:26.725007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9824fb-c2fa-4ef8-ad05-5cc85a52e128 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:26.725007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9824fb-c2fa-4ef8-ad05-5cc85a52e128 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:26.725007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9824fb-c2fa-4ef8-ad05-5cc85a52e128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:26.747467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9e9824fb-c2fa-4ef8-ad05-5cc85a52e128 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:26.749173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9e9824fb-c2fa-4ef8-ad05-5cc85a52e128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:26.768112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1212/2431] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:26.771683 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aca77-5943-4604-927c-d055e41e3a90 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:26.782246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982aca77-5943-4604-927c-d055e41e3a90 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:26.786980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f110b74-fcc9-47a7-a6cc-14aff06e427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:26.787645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f110b74-fcc9-47a7-a6cc-14aff06e427f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:26.787961 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f110b74-fcc9-47a7-a6cc-14aff06e427f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:26.788223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f110b74-fcc9-47a7-a6cc-14aff06e427f admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:26.788953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f110b74-fcc9-47a7-a6cc-14aff06e427f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:16:26.789254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f110b74-fcc9-47a7-a6cc-14aff06e427f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:26.791782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f110b74-fcc9-47a7-a6cc-14aff06e427f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:26.814697 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1220/2432] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:16:26.820260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9824fb-c2fa-4ef8-ad05-5cc85a52e128 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:26.834923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9824fb-c2fa-4ef8-ad05-5cc85a52e128 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:26.841738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cbfa8-ead3-4a97-8a0d-b3d75d0de1a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:26.843347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cbfa8-ead3-4a97-8a0d-b3d75d0de1a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:26.844055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cbfa8-ead3-4a97-8a0d-b3d75d0de1a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:26.851487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cbfa8-ead3-4a97-8a0d-b3d75d0de1a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:26.851487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cbfa8-ead3-4a97-8a0d-b3d75d0de1a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:26.851487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cbfa8-ead3-4a97-8a0d-b3d75d0de1a6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:27.006482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1213/2433] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:26 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:27.010521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f110b74-fcc9-47a7-a6cc-14aff06e427f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:27.021479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f110b74-fcc9-47a7-a6cc-14aff06e427f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:27.134213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b3474-78c7-43a8-9e27-c9bc120cbc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:27.135214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b3474-78c7-43a8-9e27-c9bc120cbc83 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:27.135551 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b3474-78c7-43a8-9e27-c9bc120cbc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:27.135845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b3474-78c7-43a8-9e27-c9bc120cbc83 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:27.136772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b3474-78c7-43a8-9e27-c9bc120cbc83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:27.140862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b3474-78c7-43a8-9e27-c9bc120cbc83 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:27.260786 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1221/2434] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:27 2022] POST /identity/v3/users => generated 297 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:27.261747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cbfa8-ead3-4a97-8a0d-b3d75d0de1a6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:27.273442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cbfa8-ead3-4a97-8a0d-b3d75d0de1a6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:27.286700 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374ff1c-6283-4b7f-b259-dccae86bd175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:27.287597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374ff1c-6283-4b7f-b259-dccae86bd175 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:27.288060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374ff1c-6283-4b7f-b259-dccae86bd175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:27.289516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0374ff1c-6283-4b7f-b259-dccae86bd175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:27.291261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374ff1c-6283-4b7f-b259-dccae86bd175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:27.295157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0374ff1c-6283-4b7f-b259-dccae86bd175 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:27.308695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1214/2435] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:27.313043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b3474-78c7-43a8-9e27-c9bc120cbc83 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:27.324890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b3474-78c7-43a8-9e27-c9bc120cbc83 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:27.334276 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e20a388-192f-4d57-9c0c-55e9e605174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:27.334962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20a388-192f-4d57-9c0c-55e9e605174b admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:27.335235 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20a388-192f-4d57-9c0c-55e9e605174b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:27.335504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e20a388-192f-4d57-9c0c-55e9e605174b admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:27.336287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20a388-192f-4d57-9c0c-55e9e605174b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:27.338634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e20a388-192f-4d57-9c0c-55e9e605174b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:27.354312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1222/2436] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:27.355625 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374ff1c-6283-4b7f-b259-dccae86bd175 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:27.366761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0374ff1c-6283-4b7f-b259-dccae86bd175 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:27.376846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775ecf0-53a7-4e1d-ae9c-3b71f9d48477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:27.377759 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775ecf0-53a7-4e1d-ae9c-3b71f9d48477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:27.379794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775ecf0-53a7-4e1d-ae9c-3b71f9d48477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:27.379794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a775ecf0-53a7-4e1d-ae9c-3b71f9d48477 admin admin] PATH_INFO: `/v3/projects/16973a97cd014ef7a093db403ae7fa4b/users/b48a964f30b44c519effdeb7401f3603/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:27.395739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775ecf0-53a7-4e1d-ae9c-3b71f9d48477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16973a97cd014ef7a093db403ae7fa4b, user_id=b48a964f30b44c519effdeb7401f3603, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:27.398550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a775ecf0-53a7-4e1d-ae9c-3b71f9d48477 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:27.471215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1215/2437] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:27 2022] PUT /identity/v3/projects/16973a97cd014ef7a093db403ae7fa4b/users/b48a964f30b44c519effdeb7401f3603/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:27.482873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a160d-1349-4c2c-897a-bf00c91abc92 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:27.483268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a160d-1349-4c2c-897a-bf00c91abc92 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:27.483612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34a160d-1349-4c2c-897a-bf00c91abc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:27.517750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d34a160d-1349-4c2c-897a-bf00c91abc92 None None] MFA Rules not processed for user `b48a964f30b44c519effdeb7401f3603`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:27.519059 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d34a160d-1349-4c2c-897a-bf00c91abc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:27.591691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1223/2438] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:27.597204 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775ecf0-53a7-4e1d-ae9c-3b71f9d48477 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:27.680121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a775ecf0-53a7-4e1d-ae9c-3b71f9d48477 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:27.686344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c5bfd-8145-40be-9107-c61c9731e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:27.687043 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c5bfd-8145-40be-9107-c61c9731e8de admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:27.687328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c5bfd-8145-40be-9107-c61c9731e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:27.687608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c5bfd-8145-40be-9107-c61c9731e8de admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:27.688383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c5bfd-8145-40be-9107-c61c9731e8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:27.690531 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c5bfd-8145-40be-9107-c61c9731e8de admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:27.711636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:27.817353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1216/2439] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:27 2022] POST /identity/v3/projects => generated 391 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:27.821751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a160d-1349-4c2c-897a-bf00c91abc92 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:27.833198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34a160d-1349-4c2c-897a-bf00c91abc92 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:27.905104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:27.912392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082fefa-9183-4fd0-a5c8-beff6ac45aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:27.913089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082fefa-9183-4fd0-a5c8-beff6ac45aef admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:27.913378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082fefa-9183-4fd0-a5c8-beff6ac45aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:27.913655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5082fefa-9183-4fd0-a5c8-beff6ac45aef admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:27.914435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082fefa-9183-4fd0-a5c8-beff6ac45aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:27.917960 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5082fefa-9183-4fd0-a5c8-beff6ac45aef admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:27.997946 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c5bfd-8145-40be-9107-c61c9731e8de admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:28.000245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-784c5bfd-8145-40be-9107-c61c9731e8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:28.017413 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1224/2440] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:27 2022] POST /identity/v3/users => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:28.022467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082fefa-9183-4fd0-a5c8-beff6ac45aef admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:28.033816 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5082fefa-9183-4fd0-a5c8-beff6ac45aef admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:28.038889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5bcd2-dbf0-406b-808c-bb268b13fbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:28.039547 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5bcd2-dbf0-406b-808c-bb268b13fbf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:28.039834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5bcd2-dbf0-406b-808c-bb268b13fbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:28.040688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5bcd2-dbf0-406b-808c-bb268b13fbf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:28.042428 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5bcd2-dbf0-406b-808c-bb268b13fbf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:28.044087 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b5bcd2-dbf0-406b-808c-bb268b13fbf4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:28.056446 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1225/2441] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:28.060651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5bcd2-dbf0-406b-808c-bb268b13fbf4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:28.070641 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5bcd2-dbf0-406b-808c-bb268b13fbf4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:28.077522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd139-886d-49b2-aae5-8971fe40cde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:28.078462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd139-886d-49b2-aae5-8971fe40cde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:28.078775 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd139-886d-49b2-aae5-8971fe40cde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:28.079122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88dd139-886d-49b2-aae5-8971fe40cde5 admin admin] PATH_INFO: `/v3/projects/005b91aea32a4f71a57ec1c79fc6b013/users/a64fe8a876354d019bdace40ac1e4200/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:28.109387 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c5bfd-8145-40be-9107-c61c9731e8de admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:28.112733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dd139-886d-49b2-aae5-8971fe40cde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005b91aea32a4f71a57ec1c79fc6b013, user_id=a64fe8a876354d019bdace40ac1e4200, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:28.115237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977df5c-0234-4461-9a48-2e1a2d1fe73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:28.115901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977df5c-0234-4461-9a48-2e1a2d1fe73d service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:28.116219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977df5c-0234-4461-9a48-2e1a2d1fe73d service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:28.116498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9977df5c-0234-4461-9a48-2e1a2d1fe73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:28.116719 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88dd139-886d-49b2-aae5-8971fe40cde5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:28.125276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9977df5c-0234-4461-9a48-2e1a2d1fe73d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:28.139029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977df5c-0234-4461-9a48-2e1a2d1fe73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:28.166508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9977df5c-0234-4461-9a48-2e1a2d1fe73d service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:28.166508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1217/2442] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:16:28.235512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1226/2443] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:28 2022] PUT /identity/v3/projects/005b91aea32a4f71a57ec1c79fc6b013/users/a64fe8a876354d019bdace40ac1e4200/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:28.236735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977df5c-0234-4461-9a48-2e1a2d1fe73d service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:28.251037 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9977df5c-0234-4461-9a48-2e1a2d1fe73d service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:28.375346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d66f6-da8c-449c-b02d-568f0171b00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:28.376871 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d66f6-da8c-449c-b02d-568f0171b00e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:28.377388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d66f6-da8c-449c-b02d-568f0171b00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:28.377869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d66f6-da8c-449c-b02d-568f0171b00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:28.378837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d66f6-da8c-449c-b02d-568f0171b00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:28.380754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d66f6-da8c-449c-b02d-568f0171b00e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:28.394411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1218/2444] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:28 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:28.401230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd139-886d-49b2-aae5-8971fe40cde5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:28.414651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88dd139-886d-49b2-aae5-8971fe40cde5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:28.422859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687b17a-60df-429d-8cb9-af3479ceced4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:28.424216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687b17a-60df-429d-8cb9-af3479ceced4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:28.424216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687b17a-60df-429d-8cb9-af3479ceced4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:28.424543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687b17a-60df-429d-8cb9-af3479ceced4 admin admin] PATH_INFO: `/v3/projects/005b91aea32a4f71a57ec1c79fc6b013/users/a64fe8a876354d019bdace40ac1e4200/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:28.426654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687b17a-60df-429d-8cb9-af3479ceced4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=005b91aea32a4f71a57ec1c79fc6b013, user_id=a64fe8a876354d019bdace40ac1e4200, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:28.430401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687b17a-60df-429d-8cb9-af3479ceced4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:28.458468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1227/2445] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:28 2022] PUT /identity/v3/projects/005b91aea32a4f71a57ec1c79fc6b013/users/a64fe8a876354d019bdace40ac1e4200/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:28.459904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb93be-7567-4df1-9685-5aa3cc44d7d3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:28.460315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb93be-7567-4df1-9685-5aa3cc44d7d3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:28.460669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb93be-7567-4df1-9685-5aa3cc44d7d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:28.535812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-38eb93be-7567-4df1-9685-5aa3cc44d7d3 None None] MFA Rules not processed for user `a64fe8a876354d019bdace40ac1e4200`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:28.537133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-38eb93be-7567-4df1-9685-5aa3cc44d7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:28.653922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1219/2446] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:28.666966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687b17a-60df-429d-8cb9-af3479ceced4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:28.670622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2687b17a-60df-429d-8cb9-af3479ceced4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:28.781424 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687b17a-60df-429d-8cb9-af3479ceced4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:28.786813 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40f669-f833-44a7-81c1-aab9be20fd16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:28.787481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f669-f833-44a7-81c1-aab9be20fd16 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:28.787768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f669-f833-44a7-81c1-aab9be20fd16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:28.788051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f669-f833-44a7-81c1-aab9be20fd16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:28.809109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40f669-f833-44a7-81c1-aab9be20fd16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:28.811304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40f669-f833-44a7-81c1-aab9be20fd16 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:28.824350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1228/2447] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:28.883476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb93be-7567-4df1-9685-5aa3cc44d7d3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:28.885498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-38eb93be-7567-4df1-9685-5aa3cc44d7d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:28.913009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb93be-7567-4df1-9685-5aa3cc44d7d3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:28.913009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc847a51-ad7f-4371-9e91-178d72a395a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:28.913009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc847a51-ad7f-4371-9e91-178d72a395a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:28.913009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc847a51-ad7f-4371-9e91-178d72a395a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:28.913468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc847a51-ad7f-4371-9e91-178d72a395a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:28.945943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:29.016337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc847a51-ad7f-4371-9e91-178d72a395a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:29.017904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc847a51-ad7f-4371-9e91-178d72a395a6 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:29.029281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1220/2448] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:32.733953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40f669-f833-44a7-81c1-aab9be20fd16 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:32.735447 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ea40f669-f833-44a7-81c1-aab9be20fd16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:32.811779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40f669-f833-44a7-81c1-aab9be20fd16 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:32.816785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706ec91-5f0b-48db-8ae9-af1d0ef57534 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e52a3464d8f4a3fa16a102336a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:32.817450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706ec91-5f0b-48db-8ae9-af1d0ef57534 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:32.817715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706ec91-5f0b-48db-8ae9-af1d0ef57534 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:32.817989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706ec91-5f0b-48db-8ae9-af1d0ef57534 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:32.819749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8706ec91-5f0b-48db-8ae9-af1d0ef57534 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:32.832586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706ec91-5f0b-48db-8ae9-af1d0ef57534 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:32.834103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706ec91-5f0b-48db-8ae9-af1d0ef57534 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:32.844678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1229/2449] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:32.934242 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc847a51-ad7f-4371-9e91-178d72a395a6 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:32.935659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cc847a51-ad7f-4371-9e91-178d72a395a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:33.016150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc847a51-ad7f-4371-9e91-178d72a395a6 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:33.020853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:33.021716 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:33.021998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:33.022925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] PATH_INFO: `/v3/users/c1c4f2a6178140858efd4599a3f975d6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:33.024266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c4f2a6178140858efd4599a3f975d6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:33.026334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:33.283434 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c4f2a6178140858efd4599a3f975d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:33.298307 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c4f2a6178140858efd4599a3f975d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:33.305283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c4f2a6178140858efd4599a3f975d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:33.306745 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c4f2a6178140858efd4599a3f975d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:33.307359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2475d8c3-1c1d-4342-86f8-bdde6b73fe88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c4f2a6178140858efd4599a3f975d6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:33.470555 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1221/2450] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:32 2022] DELETE /identity/v3/users/c1c4f2a6178140858efd4599a3f975d6 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:33.852512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706ec91-5f0b-48db-8ae9-af1d0ef57534 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:33.857457 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:33.864950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706ec91-5f0b-48db-8ae9-af1d0ef57534 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:33.947440 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:33.948442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:33.948800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:33.949073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] PATH_INFO: `/v3/projects/82b4e98c01904b04927afc617de8b11c` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:33.950271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82b4e98c01904b04927afc617de8b11c)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:33.952299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:34.115392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82b4e98c01904b04927afc617de8b11c', 'request_id': 'req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:34.121708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82b4e98c01904b04927afc617de8b11c', 'request_id': 'req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:34.209694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82b4e98c01904b04927afc617de8b11c', 'request_id': 'req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:34.226699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] The token cache is being invalidate because project 82b4e98c01904b04927afc617de8b11c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:34.226975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:34.232574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cb9b2dd9-c93f-4f5a-be48-023b6b93fe93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:34.234283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1230/2451] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:33 2022] DELETE /identity/v3/projects/82b4e98c01904b04927afc617de8b11c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:34.240569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273048e-7741-49ab-8f81-816fc105ce13 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:34.241124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273048e-7741-49ab-8f81-816fc105ce13 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:34.241124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273048e-7741-49ab-8f81-816fc105ce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:34.266218 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b273048e-7741-49ab-8f81-816fc105ce13 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:34.267446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b273048e-7741-49ab-8f81-816fc105ce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:34.325112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:34.353611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1222/2452] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:34.362367 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748948f-4762-465d-a312-7d83a8654b63 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:34.362701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748948f-4762-465d-a312-7d83a8654b63 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:34.363052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c748948f-4762-465d-a312-7d83a8654b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:34.382746 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c748948f-4762-465d-a312-7d83a8654b63 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:34.384691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c748948f-4762-465d-a312-7d83a8654b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:34.392872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1231/2453] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:34.397206 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273048e-7741-49ab-8f81-816fc105ce13 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:34.408278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273048e-7741-49ab-8f81-816fc105ce13 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:34.413180 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177afb13-5e81-4a42-a2af-8e0b45fdd5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:34.414052 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177afb13-5e81-4a42-a2af-8e0b45fdd5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:34.414164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177afb13-5e81-4a42-a2af-8e0b45fdd5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:34.414432 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177afb13-5e81-4a42-a2af-8e0b45fdd5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:34.415149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177afb13-5e81-4a42-a2af-8e0b45fdd5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:16:34.415525 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177afb13-5e81-4a42-a2af-8e0b45fdd5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:34.417516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177afb13-5e81-4a42-a2af-8e0b45fdd5ce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:34.429677 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1223/2454] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:16:34.435612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748948f-4762-465d-a312-7d83a8654b63 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:34.445323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c748948f-4762-465d-a312-7d83a8654b63 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:34.451476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc05d80-3e11-4b7b-939f-1c0e2f5d55b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:34.457617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05d80-3e11-4b7b-939f-1c0e2f5d55b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:34.457617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05d80-3e11-4b7b-939f-1c0e2f5d55b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:34.457617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc05d80-3e11-4b7b-939f-1c0e2f5d55b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:34.457617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc05d80-3e11-4b7b-939f-1c0e2f5d55b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:34.457617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc05d80-3e11-4b7b-939f-1c0e2f5d55b9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:34.614625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1232/2455] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:34 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:34.619945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177afb13-5e81-4a42-a2af-8e0b45fdd5ce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:34.631959 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177afb13-5e81-4a42-a2af-8e0b45fdd5ce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:34.692322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b0f0-925c-4d72-8b7c-94f26b80bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:34.692996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b0f0-925c-4d72-8b7c-94f26b80bb35 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:34.693319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b0f0-925c-4d72-8b7c-94f26b80bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:34.693597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7b0f0-925c-4d72-8b7c-94f26b80bb35 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:34.694292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b0f0-925c-4d72-8b7c-94f26b80bb35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:34.696894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7b0f0-925c-4d72-8b7c-94f26b80bb35 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:34.797733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1224/2456] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:34 2022] POST /identity/v3/users => generated 305 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:34.798899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc05d80-3e11-4b7b-939f-1c0e2f5d55b9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:34.811775 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc05d80-3e11-4b7b-939f-1c0e2f5d55b9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:34.816820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aefaa1-f854-4588-a081-675a67ad8933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:34.817492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aefaa1-f854-4588-a081-675a67ad8933 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:34.817776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aefaa1-f854-4588-a081-675a67ad8933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:34.818055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aefaa1-f854-4588-a081-675a67ad8933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:34.818791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aefaa1-f854-4588-a081-675a67ad8933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:34.820443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aefaa1-f854-4588-a081-675a67ad8933 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:34.833453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1233/2457] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:34.838895 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b0f0-925c-4d72-8b7c-94f26b80bb35 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:34.849857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7b0f0-925c-4d72-8b7c-94f26b80bb35 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:34.857338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b45eb-abca-474c-a3b0-f49c67dee37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:34.858038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b45eb-abca-474c-a3b0-f49c67dee37e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:34.858374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b45eb-abca-474c-a3b0-f49c67dee37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:34.858654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b45eb-abca-474c-a3b0-f49c67dee37e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:34.860017 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b45eb-abca-474c-a3b0-f49c67dee37e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:34.861969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b45eb-abca-474c-a3b0-f49c67dee37e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:34.882416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1225/2458] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:34.883513 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aefaa1-f854-4588-a081-675a67ad8933 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:34.894630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aefaa1-f854-4588-a081-675a67ad8933 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:34.901839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d8b4d-cf5e-47db-892e-05d7b8bfb304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:34.907462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d8b4d-cf5e-47db-892e-05d7b8bfb304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:34.907462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d8b4d-cf5e-47db-892e-05d7b8bfb304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:34.907462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d8b4d-cf5e-47db-892e-05d7b8bfb304 admin admin] PATH_INFO: `/v3/projects/9437ceba22ab4e2cb018729c227eb564/users/14e204f5521049b7845b78bfd20408a8/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:34.925170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d8b4d-cf5e-47db-892e-05d7b8bfb304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9437ceba22ab4e2cb018729c227eb564, user_id=14e204f5521049b7845b78bfd20408a8, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:34.928304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d8b4d-cf5e-47db-892e-05d7b8bfb304 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:35.000986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1234/2459] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:34 2022] PUT /identity/v3/projects/9437ceba22ab4e2cb018729c227eb564/users/14e204f5521049b7845b78bfd20408a8/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:35.011462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8026d-1f82-487b-84a2-0028c8666d75 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:35.011752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8026d-1f82-487b-84a2-0028c8666d75 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:35.012065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b8026d-1f82-487b-84a2-0028c8666d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:35.040970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-85b8026d-1f82-487b-84a2-0028c8666d75 None None] MFA Rules not processed for user `14e204f5521049b7845b78bfd20408a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:35.042467 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-85b8026d-1f82-487b-84a2-0028c8666d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:35.110029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1226/2460] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:35.114740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d8b4d-cf5e-47db-892e-05d7b8bfb304 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:35.146856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:35.183754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d8b4d-cf5e-47db-892e-05d7b8bfb304 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:35.188729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782903a-6695-440b-a010-a9cfea54be74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:35.189388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782903a-6695-440b-a010-a9cfea54be74 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:35.189672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782903a-6695-440b-a010-a9cfea54be74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:35.189942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782903a-6695-440b-a010-a9cfea54be74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:35.190678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782903a-6695-440b-a010-a9cfea54be74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:35.192632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782903a-6695-440b-a010-a9cfea54be74 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:35.290636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1235/2461] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:35 2022] POST /identity/v3/projects => generated 409 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:35.295568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8026d-1f82-487b-84a2-0028c8666d75 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:35.310015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b8026d-1f82-487b-84a2-0028c8666d75 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:35.344628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:35.371669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d0e26-3118-4118-bba9-b46e3e464334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:35.372382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d0e26-3118-4118-bba9-b46e3e464334 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:35.372664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d0e26-3118-4118-bba9-b46e3e464334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:35.372937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189d0e26-3118-4118-bba9-b46e3e464334 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:35.373628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d0e26-3118-4118-bba9-b46e3e464334 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:35.375571 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189d0e26-3118-4118-bba9-b46e3e464334 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:35.516452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1227/2462] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:35 2022] POST /identity/v3/users => generated 311 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:35.520676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782903a-6695-440b-a010-a9cfea54be74 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:35.532693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782903a-6695-440b-a010-a9cfea54be74 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:35.537277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e69b7-6df1-464f-a7ee-d11232746c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:35.537945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e69b7-6df1-464f-a7ee-d11232746c52 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:35.538227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e69b7-6df1-464f-a7ee-d11232746c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:35.538505 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7e69b7-6df1-464f-a7ee-d11232746c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:35.539275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e69b7-6df1-464f-a7ee-d11232746c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:35.541910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7e69b7-6df1-464f-a7ee-d11232746c52 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:35.553350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1236/2463] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:35.558516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d0e26-3118-4118-bba9-b46e3e464334 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:35.570380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189d0e26-3118-4118-bba9-b46e3e464334 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:35.576539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325494f-ea2a-453b-9fd9-fbe40cc16de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:35.577463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325494f-ea2a-453b-9fd9-fbe40cc16de3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:35.577752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325494f-ea2a-453b-9fd9-fbe40cc16de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:35.578024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325494f-ea2a-453b-9fd9-fbe40cc16de3 admin admin] PATH_INFO: `/v3/projects/1e03629ae1234bbb8c2a6053ca77efb6/users/546c17cbd8e84a0b8e58cd1db3754e94/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:35.595381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325494f-ea2a-453b-9fd9-fbe40cc16de3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e03629ae1234bbb8c2a6053ca77efb6, user_id=546c17cbd8e84a0b8e58cd1db3754e94, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:35.598139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e325494f-ea2a-453b-9fd9-fbe40cc16de3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:35.694761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1228/2464] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:35 2022] PUT /identity/v3/projects/1e03629ae1234bbb8c2a6053ca77efb6/users/546c17cbd8e84a0b8e58cd1db3754e94/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:35.699222 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e69b7-6df1-464f-a7ee-d11232746c52 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:35.710853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7e69b7-6df1-464f-a7ee-d11232746c52 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:35.722404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325494f-ea2a-453b-9fd9-fbe40cc16de3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:35.724174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e325494f-ea2a-453b-9fd9-fbe40cc16de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:35.794765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6296c-edab-4928-9942-586252a33773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:35.795462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6296c-edab-4928-9942-586252a33773 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:35.795818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6296c-edab-4928-9942-586252a33773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:35.796214 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6296c-edab-4928-9942-586252a33773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:35.797121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6296c-edab-4928-9942-586252a33773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:35.798884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d6296c-edab-4928-9942-586252a33773 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:35.810463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325494f-ea2a-453b-9fd9-fbe40cc16de3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:35.812125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1237/2465] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:35.816084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:35.816342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6296c-edab-4928-9942-586252a33773 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:35.817120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:35.817590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:35.818030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] PATH_INFO: `/v3/users/b48a964f30b44c519effdeb7401f3603` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:35.819235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b48a964f30b44c519effdeb7401f3603)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:35.821901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:35.828556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6296c-edab-4928-9942-586252a33773 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:35.834187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35bad2-6774-4ec0-8822-785b1f3dc10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:35.838650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35bad2-6774-4ec0-8822-785b1f3dc10a admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:35.838650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35bad2-6774-4ec0-8822-785b1f3dc10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:35.838650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35bad2-6774-4ec0-8822-785b1f3dc10a admin admin] PATH_INFO: `/v3/projects/1e03629ae1234bbb8c2a6053ca77efb6/users/546c17cbd8e84a0b8e58cd1db3754e94/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:35.839254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35bad2-6774-4ec0-8822-785b1f3dc10a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e03629ae1234bbb8c2a6053ca77efb6, user_id=546c17cbd8e84a0b8e58cd1db3754e94, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:35.842756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35bad2-6774-4ec0-8822-785b1f3dc10a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:35.855809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1238/2466] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:35 2022] PUT /identity/v3/projects/1e03629ae1234bbb8c2a6053ca77efb6/users/546c17cbd8e84a0b8e58cd1db3754e94/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:35.866193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee074309-d6b5-4641-9ab8-76f8d46d949c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:35.867359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee074309-d6b5-4641-9ab8-76f8d46d949c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:35.867359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee074309-d6b5-4641-9ab8-76f8d46d949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:35.896108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ee074309-d6b5-4641-9ab8-76f8d46d949c None None] MFA Rules not processed for user `546c17cbd8e84a0b8e58cd1db3754e94`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:35.897202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ee074309-d6b5-4641-9ab8-76f8d46d949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:36.005249 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1239/2467] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:35 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:36.020364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee074309-d6b5-4641-9ab8-76f8d46d949c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:36.022457 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ee074309-d6b5-4641-9ab8-76f8d46d949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:36.043034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:36.099684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee074309-d6b5-4641-9ab8-76f8d46d949c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:36.105167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0089bd5-5c26-44af-8f13-d265cc8899b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:36.105813 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089bd5-5c26-44af-8f13-d265cc8899b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:36.106095 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089bd5-5c26-44af-8f13-d265cc8899b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:36.106369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0089bd5-5c26-44af-8f13-d265cc8899b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:36.115995 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0089bd5-5c26-44af-8f13-d265cc8899b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:36.117452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0089bd5-5c26-44af-8f13-d265cc8899b7 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:36.133875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1240/2468] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:36 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:37.514767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b48a964f30b44c519effdeb7401f3603'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:37.527158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b48a964f30b44c519effdeb7401f3603'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:37.534640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b48a964f30b44c519effdeb7401f3603'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:37.535458 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b48a964f30b44c519effdeb7401f3603'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:37.536165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b48a964f30b44c519effdeb7401f3603'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:37.655629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1229/2469] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:35 2022] DELETE /identity/v3/users/b48a964f30b44c519effdeb7401f3603 => generated 0 bytes in 1934 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:37.660321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20e058-190e-48da-8682-0874b4144b96 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:37.660793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20e058-190e-48da-8682-0874b4144b96 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:37.660910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc20e058-190e-48da-8682-0874b4144b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:37.679679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fc20e058-190e-48da-8682-0874b4144b96 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:37.681961 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fc20e058-190e-48da-8682-0874b4144b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:37.741342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1241/2470] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:37.751982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:37.753510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:37.755004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20e058-190e-48da-8682-0874b4144b96 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:37.756607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fc20e058-190e-48da-8682-0874b4144b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:37.774632 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:37.814954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc20e058-190e-48da-8682-0874b4144b96 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:37.815205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162fe001-a945-47aa-ad0a-232538d36062 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:37.819025 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb0945-e8a3-48ba-b9b8-c3f685e0241f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:37.824980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3ef2f-68d8-4673-a64d-1b2c963a62c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:37.825114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0945-e8a3-48ba-b9b8-c3f685e0241f service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:37.825216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3ef2f-68d8-4673-a64d-1b2c963a62c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:37.825322 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0945-e8a3-48ba-b9b8-c3f685e0241f service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:37.825429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3ef2f-68d8-4673-a64d-1b2c963a62c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:37.825535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0945-e8a3-48ba-b9b8-c3f685e0241f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:37.825626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3ef2f-68d8-4673-a64d-1b2c963a62c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:37.825626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eab3ef2f-68d8-4673-a64d-1b2c963a62c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:37.830361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb0945-e8a3-48ba-b9b8-c3f685e0241f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:37.831803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb0945-e8a3-48ba-b9b8-c3f685e0241f service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:37.842785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1230/2471] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:37.884287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3ef2f-68d8-4673-a64d-1b2c963a62c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:37.885809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3ef2f-68d8-4673-a64d-1b2c963a62c7 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:37.895291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1242/2472] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:16:38.340072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb0945-e8a3-48ba-b9b8-c3f685e0241f service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:38.340072 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8feb0945-e8a3-48ba-b9b8-c3f685e0241f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:38.357400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb0945-e8a3-48ba-b9b8-c3f685e0241f service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:38.363339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:38.370193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:38.370193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:38.370193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] PATH_INFO: `/v3/projects/16973a97cd014ef7a093db403ae7fa4b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:38.370193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] RBAC: Authorizing `identity:delete_project(project_id=16973a97cd014ef7a093db403ae7fa4b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:38.370193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:38.521431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16973a97cd014ef7a093db403ae7fa4b', 'request_id': 'req-910dba27-5f0f-4dd6-8b33-29ec071a917e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:38.527335 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16973a97cd014ef7a093db403ae7fa4b', 'request_id': 'req-910dba27-5f0f-4dd6-8b33-29ec071a917e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:38.664211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16973a97cd014ef7a093db403ae7fa4b', 'request_id': 'req-910dba27-5f0f-4dd6-8b33-29ec071a917e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:38.667617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf75b-76c4-4f96-9f52-cabbb8170d67 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:38.670655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf75b-76c4-4f96-9f52-cabbb8170d67 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:38.670655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf75b-76c4-4f96-9f52-cabbb8170d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:38.680205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] The token cache is being invalidate because project 16973a97cd014ef7a093db403ae7fa4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:38.681144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:38.682226 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:38.684220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1231/2473] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:38 2022] DELETE /identity/v3/projects/16973a97cd014ef7a093db403ae7fa4b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:38.687137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5d7bf75b-76c4-4f96-9f52-cabbb8170d67 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:38.688427 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5d7bf75b-76c4-4f96-9f52-cabbb8170d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:38.693062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:38.701683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:38.703804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:38.756030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1243/2474] 10.222.0.85 () {58 vars in 967 bytes} [Wed Jul 20 22:16:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:38.770251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf75b-76c4-4f96-9f52-cabbb8170d67 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:38.771665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5d7bf75b-76c4-4f96-9f52-cabbb8170d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:38.784926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910dba27-5f0f-4dd6-8b33-29ec071a917e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:38.789884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:38.790773 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:38.791534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:38.791812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] PATH_INFO: `/v3/users/a64fe8a876354d019bdace40ac1e4200` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:38.793375 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64fe8a876354d019bdace40ac1e4200)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:38.795446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:38.850600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf75b-76c4-4f96-9f52-cabbb8170d67 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:38.856062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc989b-4a42-4573-bc4a-1aaad797c0a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:38.856695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc989b-4a42-4573-bc4a-1aaad797c0a5 service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:38.856978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc989b-4a42-4573-bc4a-1aaad797c0a5 service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:38.857251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc989b-4a42-4573-bc4a-1aaad797c0a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:38.865647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc989b-4a42-4573-bc4a-1aaad797c0a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:38.867244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc989b-4a42-4573-bc4a-1aaad797c0a5 service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:38.876651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1244/2475] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:16:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 22:16:39.043045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:39.044749 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64fe8a876354d019bdace40ac1e4200'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:39.057906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64fe8a876354d019bdace40ac1e4200'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:39.065357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64fe8a876354d019bdace40ac1e4200'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:39.066813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64fe8a876354d019bdace40ac1e4200'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:39.066813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac5356ae-cde3-432e-9ec5-832adbcd225c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64fe8a876354d019bdace40ac1e4200'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:39.198360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1232/2476] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:38 2022] DELETE /identity/v3/users/a64fe8a876354d019bdace40ac1e4200 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:39.768893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc989b-4a42-4573-bc4a-1aaad797c0a5 service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:39.792192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc989b-4a42-4573-bc4a-1aaad797c0a5 service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:39.874009 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:39.875490 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:39.876345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:39.876855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] PATH_INFO: `/v3/projects/005b91aea32a4f71a57ec1c79fc6b013` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:39.878841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=005b91aea32a4f71a57ec1c79fc6b013)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:39.881645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:40.203363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:40.206439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '005b91aea32a4f71a57ec1c79fc6b013', 'request_id': 'req-2d5b6a5b-aa19-43a6-85ce-350f6c370795'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:40.212866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '005b91aea32a4f71a57ec1c79fc6b013', 'request_id': 'req-2d5b6a5b-aa19-43a6-85ce-350f6c370795'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:40.341394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '005b91aea32a4f71a57ec1c79fc6b013', 'request_id': 'req-2d5b6a5b-aa19-43a6-85ce-350f6c370795'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:40.353609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] The token cache is being invalidate because project 005b91aea32a4f71a57ec1c79fc6b013 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:40.353858 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:40.354580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-2d5b6a5b-aa19-43a6-85ce-350f6c370795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:40.356158 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1245/2477] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:39 2022] DELETE /identity/v3/projects/005b91aea32a4f71a57ec1c79fc6b013 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:40.361104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29dead-2a4f-402c-ba39-cb38222c73dc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:40.361617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29dead-2a4f-402c-ba39-cb38222c73dc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:40.361718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29dead-2a4f-402c-ba39-cb38222c73dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:40.384201 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ed29dead-2a4f-402c-ba39-cb38222c73dc None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:40.384201 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ed29dead-2a4f-402c-ba39-cb38222c73dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:40.443939 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1233/2478] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:40.452765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863dd9c-b26e-46e5-8748-46a5eae61774 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:40.453054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863dd9c-b26e-46e5-8748-46a5eae61774 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:40.453332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863dd9c-b26e-46e5-8748-46a5eae61774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:40.472054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7863dd9c-b26e-46e5-8748-46a5eae61774 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:40.473262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7863dd9c-b26e-46e5-8748-46a5eae61774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:40.483640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1246/2479] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:40.488167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29dead-2a4f-402c-ba39-cb38222c73dc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:40.499419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29dead-2a4f-402c-ba39-cb38222c73dc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:40.504087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936f0e-a80a-4163-86bd-944b9f76d47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:40.504875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936f0e-a80a-4163-86bd-944b9f76d47f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:40.506933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936f0e-a80a-4163-86bd-944b9f76d47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:40.507222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64936f0e-a80a-4163-86bd-944b9f76d47f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:40.507995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64936f0e-a80a-4163-86bd-944b9f76d47f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:16:40.508313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64936f0e-a80a-4163-86bd-944b9f76d47f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:40.510169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64936f0e-a80a-4163-86bd-944b9f76d47f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:40.522266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1234/2480] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:16:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:16:40.527164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863dd9c-b26e-46e5-8748-46a5eae61774 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:40.536511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863dd9c-b26e-46e5-8748-46a5eae61774 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:40.542347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef12dc-cdd3-4ea3-b65d-cdf8bc83fa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:40.547524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef12dc-cdd3-4ea3-b65d-cdf8bc83fa28 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:40.547524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef12dc-cdd3-4ea3-b65d-cdf8bc83fa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:40.547524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ef12dc-cdd3-4ea3-b65d-cdf8bc83fa28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:40.547524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef12dc-cdd3-4ea3-b65d-cdf8bc83fa28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:40.547524 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ef12dc-cdd3-4ea3-b65d-cdf8bc83fa28 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:40.673499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1247/2481] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:40 2022] POST /identity/v3/projects => generated 379 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:40.677689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936f0e-a80a-4163-86bd-944b9f76d47f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:40.688613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64936f0e-a80a-4163-86bd-944b9f76d47f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:40.764111 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d05ab-7906-4e75-adc2-069fa81a7365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:40.764875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d05ab-7906-4e75-adc2-069fa81a7365 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:40.765236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d05ab-7906-4e75-adc2-069fa81a7365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:40.766087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373d05ab-7906-4e75-adc2-069fa81a7365 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:40.767014 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d05ab-7906-4e75-adc2-069fa81a7365 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:40.769105 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373d05ab-7906-4e75-adc2-069fa81a7365 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:40.870366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1235/2482] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:40 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:40.874753 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef12dc-cdd3-4ea3-b65d-cdf8bc83fa28 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:40.885532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ef12dc-cdd3-4ea3-b65d-cdf8bc83fa28 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:40.890303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb25682-ba78-43cc-a387-f301350eecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:40.891180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb25682-ba78-43cc-a387-f301350eecb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:40.891461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb25682-ba78-43cc-a387-f301350eecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:40.891734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb25682-ba78-43cc-a387-f301350eecb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:40.892484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb25682-ba78-43cc-a387-f301350eecb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:40.894185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb25682-ba78-43cc-a387-f301350eecb6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:40.905805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1248/2483] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:40.914482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d05ab-7906-4e75-adc2-069fa81a7365 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:40.926290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373d05ab-7906-4e75-adc2-069fa81a7365 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:40.931677 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7d370-b783-45de-aa27-367add05bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:40.932365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d370-b783-45de-aa27-367add05bb39 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:40.932652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d370-b783-45de-aa27-367add05bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:40.933036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7d370-b783-45de-aa27-367add05bb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:40.933835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7d370-b783-45de-aa27-367add05bb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:40.935477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7d370-b783-45de-aa27-367add05bb39 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:40.947336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1236/2484] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:40.954904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb25682-ba78-43cc-a387-f301350eecb6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:40.965738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb25682-ba78-43cc-a387-f301350eecb6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:40.970485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c1696-daf2-4b3f-9fe1-b914973ad7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:40.971362 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c1696-daf2-4b3f-9fe1-b914973ad7b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:40.971644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c1696-daf2-4b3f-9fe1-b914973ad7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:40.971959 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917c1696-daf2-4b3f-9fe1-b914973ad7b7 admin admin] PATH_INFO: `/v3/projects/100dbc2826334855bcbc56c59c6d9fea/users/60a6ff0001a1459181063bbdf76b2e02/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:40.988615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c1696-daf2-4b3f-9fe1-b914973ad7b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=100dbc2826334855bcbc56c59c6d9fea, user_id=60a6ff0001a1459181063bbdf76b2e02, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:40.991392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917c1696-daf2-4b3f-9fe1-b914973ad7b7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:41.118926 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1249/2485] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:40 2022] PUT /identity/v3/projects/100dbc2826334855bcbc56c59c6d9fea/users/60a6ff0001a1459181063bbdf76b2e02/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:41.130480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb23f-46fa-403d-b623-c8da48af35d1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:41.130772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb23f-46fa-403d-b623-c8da48af35d1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:41.131050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6eb23f-46fa-403d-b623-c8da48af35d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:41.158009 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bb6eb23f-46fa-403d-b623-c8da48af35d1 None None] MFA Rules not processed for user `60a6ff0001a1459181063bbdf76b2e02`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:41.159220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bb6eb23f-46fa-403d-b623-c8da48af35d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:41.176928 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:41.224694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1237/2486] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:41.229533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c1696-daf2-4b3f-9fe1-b914973ad7b7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:41.292279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917c1696-daf2-4b3f-9fe1-b914973ad7b7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:41.297029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09158c-e8d9-42f3-89e5-cc1d9185058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:41.297730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09158c-e8d9-42f3-89e5-cc1d9185058f admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:41.298011 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09158c-e8d9-42f3-89e5-cc1d9185058f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:41.298342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09158c-e8d9-42f3-89e5-cc1d9185058f admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:41.299107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09158c-e8d9-42f3-89e5-cc1d9185058f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:41.301058 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09158c-e8d9-42f3-89e5-cc1d9185058f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:41.406481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1250/2487] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:41 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:41.411548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eb23f-46fa-403d-b623-c8da48af35d1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:41.423026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6eb23f-46fa-403d-b623-c8da48af35d1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:41.480710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad122-c75f-46f1-b14d-ad7608298110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:41.481498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad122-c75f-46f1-b14d-ad7608298110 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:41.481783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad122-c75f-46f1-b14d-ad7608298110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:41.482086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ad122-c75f-46f1-b14d-ad7608298110 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:41.482793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ad122-c75f-46f1-b14d-ad7608298110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:41.484765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ad122-c75f-46f1-b14d-ad7608298110 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:41.598294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1238/2488] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:41 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:41.602319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09158c-e8d9-42f3-89e5-cc1d9185058f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:41.612761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09158c-e8d9-42f3-89e5-cc1d9185058f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:41.617404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b604-8a8a-4e01-81d0-5842ff7817d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:41.618574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b604-8a8a-4e01-81d0-5842ff7817d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:41.618988 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b604-8a8a-4e01-81d0-5842ff7817d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:41.619299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8b604-8a8a-4e01-81d0-5842ff7817d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:41.620052 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8b604-8a8a-4e01-81d0-5842ff7817d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:41.621623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8b604-8a8a-4e01-81d0-5842ff7817d6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:41.632351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1251/2489] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:41.637395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad122-c75f-46f1-b14d-ad7608298110 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:41.647744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ad122-c75f-46f1-b14d-ad7608298110 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:41.652929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab60ef-80cf-4a5f-af57-539e2ac6f7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:41.653676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab60ef-80cf-4a5f-af57-539e2ac6f7ec admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:41.653964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab60ef-80cf-4a5f-af57-539e2ac6f7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:41.654273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab60ef-80cf-4a5f-af57-539e2ac6f7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:41.655138 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab60ef-80cf-4a5f-af57-539e2ac6f7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:41.657023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab60ef-80cf-4a5f-af57-539e2ac6f7ec admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:41.671977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1239/2490] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:41.673462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b604-8a8a-4e01-81d0-5842ff7817d6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:41.684946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8b604-8a8a-4e01-81d0-5842ff7817d6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:41.689893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00624bb-1ebf-4dfb-958b-804ab768fcce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:41.690828 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00624bb-1ebf-4dfb-958b-804ab768fcce admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:41.691088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00624bb-1ebf-4dfb-958b-804ab768fcce admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:41.691365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00624bb-1ebf-4dfb-958b-804ab768fcce admin admin] PATH_INFO: `/v3/projects/02606cf6caca4fa9a9408205b5849fa0/users/5072f317531b430aa6c384518987bdb0/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:41.707814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00624bb-1ebf-4dfb-958b-804ab768fcce admin admin] RBAC: Authorizing `identity:create_grant(project_id=02606cf6caca4fa9a9408205b5849fa0, user_id=5072f317531b430aa6c384518987bdb0, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:41.710485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00624bb-1ebf-4dfb-958b-804ab768fcce admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:41.815658 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1252/2491] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:41 2022] PUT /identity/v3/projects/02606cf6caca4fa9a9408205b5849fa0/users/5072f317531b430aa6c384518987bdb0/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:41.826892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13c719-b3f6-44cc-808d-4029e7fe7e77 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:41.827183 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13c719-b3f6-44cc-808d-4029e7fe7e77 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:41.827463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13c719-b3f6-44cc-808d-4029e7fe7e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:41.855966 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cb13c719-b3f6-44cc-808d-4029e7fe7e77 None None] MFA Rules not processed for user `5072f317531b430aa6c384518987bdb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:41.857293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb13c719-b3f6-44cc-808d-4029e7fe7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:41.924758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1240/2492] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:41.929282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00624bb-1ebf-4dfb-958b-804ab768fcce admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:41.954245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:41.997525 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00624bb-1ebf-4dfb-958b-804ab768fcce admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:42.010541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc255b-f055-43c2-88db-cb16974659eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:42.011438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc255b-f055-43c2-88db-cb16974659eb admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:42.011718 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc255b-f055-43c2-88db-cb16974659eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:42.012034 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc255b-f055-43c2-88db-cb16974659eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:42.012740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc255b-f055-43c2-88db-cb16974659eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:42.014721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbc255b-f055-43c2-88db-cb16974659eb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:42.157074 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1253/2493] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:41 2022] POST /identity/v3/projects => generated 379 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:42.161258 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13c719-b3f6-44cc-808d-4029e7fe7e77 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:42.175630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13c719-b3f6-44cc-808d-4029e7fe7e77 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:42.198056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:42.230095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188f60-3df3-4df8-97af-48b9d3793026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:42.230764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188f60-3df3-4df8-97af-48b9d3793026 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:42.231045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188f60-3df3-4df8-97af-48b9d3793026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:42.231363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26188f60-3df3-4df8-97af-48b9d3793026 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:42.232104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26188f60-3df3-4df8-97af-48b9d3793026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:42.234039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26188f60-3df3-4df8-97af-48b9d3793026 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:42.342472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1241/2494] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:42 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:42.346416 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc255b-f055-43c2-88db-cb16974659eb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:42.358010 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbc255b-f055-43c2-88db-cb16974659eb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:42.362694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73133870-9dde-48b6-806c-967596cb95b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:42.363348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73133870-9dde-48b6-806c-967596cb95b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:42.363645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73133870-9dde-48b6-806c-967596cb95b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:42.363913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73133870-9dde-48b6-806c-967596cb95b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:42.364716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73133870-9dde-48b6-806c-967596cb95b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:42.366285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73133870-9dde-48b6-806c-967596cb95b9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:42.377634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1254/2495] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:42.381682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188f60-3df3-4df8-97af-48b9d3793026 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:42.393273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26188f60-3df3-4df8-97af-48b9d3793026 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:42.398556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960cd3c-babb-4d60-89f8-e9e02f7d492e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:42.400004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960cd3c-babb-4d60-89f8-e9e02f7d492e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:42.402721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960cd3c-babb-4d60-89f8-e9e02f7d492e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:42.402721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6960cd3c-babb-4d60-89f8-e9e02f7d492e admin admin] PATH_INFO: `/v3/projects/bd58838cfa3c48fdbe8c9dce9ac013ae/users/3dc841fcc2b646268a138acd61a2d9be/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:42.416944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960cd3c-babb-4d60-89f8-e9e02f7d492e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd58838cfa3c48fdbe8c9dce9ac013ae, user_id=3dc841fcc2b646268a138acd61a2d9be, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:42.419663 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6960cd3c-babb-4d60-89f8-e9e02f7d492e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:42.495592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1242/2496] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:42 2022] PUT /identity/v3/projects/bd58838cfa3c48fdbe8c9dce9ac013ae/users/3dc841fcc2b646268a138acd61a2d9be/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:42.499613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73133870-9dde-48b6-806c-967596cb95b9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:42.510325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73133870-9dde-48b6-806c-967596cb95b9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:42.570709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da2603-f9d8-4db0-a7f7-80c374bee185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:42.571849 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da2603-f9d8-4db0-a7f7-80c374bee185 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:42.572169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da2603-f9d8-4db0-a7f7-80c374bee185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:42.572450 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da2603-f9d8-4db0-a7f7-80c374bee185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:42.573229 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da2603-f9d8-4db0-a7f7-80c374bee185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:42.574918 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da2603-f9d8-4db0-a7f7-80c374bee185 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:42.586234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1255/2497] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:42.590962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960cd3c-babb-4d60-89f8-e9e02f7d492e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:42.601601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6960cd3c-babb-4d60-89f8-e9e02f7d492e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:42.606945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127ec1-ad4c-48c7-ac34-5f284146a2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:42.607826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127ec1-ad4c-48c7-ac34-5f284146a2e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:42.608156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127ec1-ad4c-48c7-ac34-5f284146a2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:42.608432 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7127ec1-ad4c-48c7-ac34-5f284146a2e7 admin admin] PATH_INFO: `/v3/projects/bd58838cfa3c48fdbe8c9dce9ac013ae/users/3dc841fcc2b646268a138acd61a2d9be/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:42.610438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127ec1-ad4c-48c7-ac34-5f284146a2e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd58838cfa3c48fdbe8c9dce9ac013ae, user_id=3dc841fcc2b646268a138acd61a2d9be, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:42.613113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7127ec1-ad4c-48c7-ac34-5f284146a2e7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:42.623472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1243/2498] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:42 2022] PUT /identity/v3/projects/bd58838cfa3c48fdbe8c9dce9ac013ae/users/3dc841fcc2b646268a138acd61a2d9be/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:42.638274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64cef8-f527-4079-b8e6-e073d87a5f59 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:42.638570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64cef8-f527-4079-b8e6-e073d87a5f59 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:42.638853 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe64cef8-f527-4079-b8e6-e073d87a5f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:42.667322 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fe64cef8-f527-4079-b8e6-e073d87a5f59 None None] MFA Rules not processed for user `3dc841fcc2b646268a138acd61a2d9be`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:42.668756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fe64cef8-f527-4079-b8e6-e073d87a5f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:42.739126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1256/2499] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:42.807126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127ec1-ad4c-48c7-ac34-5f284146a2e7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:42.808864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d7127ec1-ad4c-48c7-ac34-5f284146a2e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:42.869129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7127ec1-ad4c-48c7-ac34-5f284146a2e7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:42.872839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b781f3-e878-4d81-aa58-af12374492fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:42.873484 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b781f3-e878-4d81-aa58-af12374492fe service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:42.873790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b781f3-e878-4d81-aa58-af12374492fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:42.874053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b781f3-e878-4d81-aa58-af12374492fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:42.891106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b781f3-e878-4d81-aa58-af12374492fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:42.892609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b781f3-e878-4d81-aa58-af12374492fe service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:42.902954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1244/2500] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:42 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:16:43.015708 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64cef8-f527-4079-b8e6-e073d87a5f59 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:43.017127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fe64cef8-f527-4079-b8e6-e073d87a5f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:43.029477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe64cef8-f527-4079-b8e6-e073d87a5f59 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:43.033047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e0950-fe25-4de6-9f42-5e48160b50c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:43.034793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e0950-fe25-4de6-9f42-5e48160b50c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:43.034793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e0950-fe25-4de6-9f42-5e48160b50c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:43.034793 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e0950-fe25-4de6-9f42-5e48160b50c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:43.047488 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:43.093264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e0950-fe25-4de6-9f42-5e48160b50c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:43.094699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e0950-fe25-4de6-9f42-5e48160b50c1 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:43.104422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1257/2501] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:45.703082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b781f3-e878-4d81-aa58-af12374492fe service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:45.704678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f8b781f3-e878-4d81-aa58-af12374492fe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:45.774667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b781f3-e878-4d81-aa58-af12374492fe service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:45.779820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:45.780825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:45.781134 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:45.781478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] PATH_INFO: `/v3/users/14e204f5521049b7845b78bfd20408a8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:45.782733 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e204f5521049b7845b78bfd20408a8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:45.784808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:45.809680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:46.001298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e204f5521049b7845b78bfd20408a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:46.013764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e204f5521049b7845b78bfd20408a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:46.020607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e204f5521049b7845b78bfd20408a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:46.021537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e204f5521049b7845b78bfd20408a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:46.021911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e204f5521049b7845b78bfd20408a8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:46.110796 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1245/2502] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:45 2022] DELETE /identity/v3/users/14e204f5521049b7845b78bfd20408a8 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:46.115411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9e92-946c-4297-9901-8519967dc056 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:46.115963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9e92-946c-4297-9901-8519967dc056 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:46.116076 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9e92-946c-4297-9901-8519967dc056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:46.134162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-234f9e92-946c-4297-9901-8519967dc056 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:46.135979 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-234f9e92-946c-4297-9901-8519967dc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:46.200866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1258/2503] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:46.210545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:46.212592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:46.271714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e9fd97-6dbf-49f2-b9f6-7c5675178e0f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:46.275316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59acdc-47a6-4cc0-aed0-84818d654626 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:46.276691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59acdc-47a6-4cc0-aed0-84818d654626 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:46.277115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59acdc-47a6-4cc0-aed0-84818d654626 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:46.277402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59acdc-47a6-4cc0-aed0-84818d654626 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:46.286540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59acdc-47a6-4cc0-aed0-84818d654626 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:46.288045 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59acdc-47a6-4cc0-aed0-84818d654626 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:46.298958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1246/2504] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:46.953756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9e92-946c-4297-9901-8519967dc056 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:46.955246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-234f9e92-946c-4297-9901-8519967dc056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:46.968396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9e92-946c-4297-9901-8519967dc056 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:46.973032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:46.973891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:46.974165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:46.974473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] PATH_INFO: `/v3/projects/9437ceba22ab4e2cb018729c227eb564` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:46.975619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9437ceba22ab4e2cb018729c227eb564)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:46.977564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:47.080106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9437ceba22ab4e2cb018729c227eb564', 'request_id': 'req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.085861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9437ceba22ab4e2cb018729c227eb564', 'request_id': 'req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.163234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9437ceba22ab4e2cb018729c227eb564', 'request_id': 'req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.176032 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] The token cache is being invalidate because project 9437ceba22ab4e2cb018729c227eb564 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:47.177173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.177173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.178556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1259/2505] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:46 2022] DELETE /identity/v3/projects/9437ceba22ab4e2cb018729c227eb564 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:47.183415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59acdc-47a6-4cc0-aed0-84818d654626 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:47.193376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59acdc-47a6-4cc0-aed0-84818d654626 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:47.252370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:47.253242 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:47.253545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:47.253832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] PATH_INFO: `/v3/users/546c17cbd8e84a0b8e58cd1db3754e94` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:47.255033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546c17cbd8e84a0b8e58cd1db3754e94)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:47.257029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:47.335950 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:47.337596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:47.350954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b133fd-69e7-4d4f-921e-9b7b61a2e03d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:47.356650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:47.357517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:47.357797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:47.358071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] PATH_INFO: `/v3/users/60a6ff0001a1459181063bbdf76b2e02` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:47.359288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a6ff0001a1459181063bbdf76b2e02)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:47.361247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:47.419574 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:47.421096 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546c17cbd8e84a0b8e58cd1db3754e94'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.434156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546c17cbd8e84a0b8e58cd1db3754e94'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.441010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546c17cbd8e84a0b8e58cd1db3754e94'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.441699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546c17cbd8e84a0b8e58cd1db3754e94'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.442299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1cebb8e8-61df-42cf-9815-4949cc655571 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546c17cbd8e84a0b8e58cd1db3754e94'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.558789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1247/2506] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:47 2022] DELETE /identity/v3/users/546c17cbd8e84a0b8e58cd1db3754e94 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:47.657055 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:47.670566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a6ff0001a1459181063bbdf76b2e02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.838125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a6ff0001a1459181063bbdf76b2e02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.855012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a6ff0001a1459181063bbdf76b2e02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.855894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a6ff0001a1459181063bbdf76b2e02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.870251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a6ff0001a1459181063bbdf76b2e02'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:47.877836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1260/2507] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:47 2022] DELETE /identity/v3/users/60a6ff0001a1459181063bbdf76b2e02 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:47.888192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fd600-b1de-44b2-81d3-1aa4f6241a18 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:47.888587 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fd600-b1de-44b2-81d3-1aa4f6241a18 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:47.888936 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fd600-b1de-44b2-81d3-1aa4f6241a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:47.906948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e10fd600-b1de-44b2-81d3-1aa4f6241a18 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:47.908268 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e10fd600-b1de-44b2-81d3-1aa4f6241a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:47.975271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1248/2508] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:47.985600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:47.986633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:48.047253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025ca872-acb8-4343-872c-d1eda3c4c3fc admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:48.051028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236fa0b-c30a-4005-bb6c-2eb7822cdfd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:48.051663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236fa0b-c30a-4005-bb6c-2eb7822cdfd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:48.051974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236fa0b-c30a-4005-bb6c-2eb7822cdfd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:48.052284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236fa0b-c30a-4005-bb6c-2eb7822cdfd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:48.062003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236fa0b-c30a-4005-bb6c-2eb7822cdfd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:48.063475 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236fa0b-c30a-4005-bb6c-2eb7822cdfd9 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:48.073386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1261/2509] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:48.152361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fd600-b1de-44b2-81d3-1aa4f6241a18 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:48.154158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e10fd600-b1de-44b2-81d3-1aa4f6241a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:48.166727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fd600-b1de-44b2-81d3-1aa4f6241a18 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:48.179824 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:48.180743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:48.181034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:48.181320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] PATH_INFO: `/v3/projects/1e03629ae1234bbb8c2a6053ca77efb6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:48.182676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e03629ae1234bbb8c2a6053ca77efb6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:48.185464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:48.349253 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e03629ae1234bbb8c2a6053ca77efb6', 'request_id': 'req-68478ae5-40a7-4423-bf2b-9220becda009'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:48.355855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e03629ae1234bbb8c2a6053ca77efb6', 'request_id': 'req-68478ae5-40a7-4423-bf2b-9220becda009'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:48.426116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e03629ae1234bbb8c2a6053ca77efb6', 'request_id': 'req-68478ae5-40a7-4423-bf2b-9220becda009'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:48.439112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] The token cache is being invalidate because project 1e03629ae1234bbb8c2a6053ca77efb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:48.439408 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:48.440119 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-68478ae5-40a7-4423-bf2b-9220becda009 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:48.441697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1249/2510] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:48 2022] DELETE /identity/v3/projects/1e03629ae1234bbb8c2a6053ca77efb6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:48.446921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3f8f0-9cec-4e64-92d0-5c7ffd5f16c0 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:48.447466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3f8f0-9cec-4e64-92d0-5c7ffd5f16c0 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:48.448302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a3f8f0-9cec-4e64-92d0-5c7ffd5f16c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:48.466448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-19a3f8f0-9cec-4e64-92d0-5c7ffd5f16c0 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:48.467693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-19a3f8f0-9cec-4e64-92d0-5c7ffd5f16c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:48.528500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1262/2511] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:48.536450 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b959672-050d-43c2-8057-e674bde3ba24 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:48.536770 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b959672-050d-43c2-8057-e674bde3ba24 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:48.537052 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b959672-050d-43c2-8057-e674bde3ba24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:48.557242 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1b959672-050d-43c2-8057-e674bde3ba24 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:48.559087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1b959672-050d-43c2-8057-e674bde3ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:48.567246 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1250/2512] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:48.571555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3f8f0-9cec-4e64-92d0-5c7ffd5f16c0 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:48.578008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b959672-050d-43c2-8057-e674bde3ba24 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:48.579621 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1b959672-050d-43c2-8057-e674bde3ba24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:48.582291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a3f8f0-9cec-4e64-92d0-5c7ffd5f16c0 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:48.587385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3a2da-1e1c-444e-abc4-043bf3e52fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:48.588088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a2da-1e1c-444e-abc4-043bf3e52fff admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:48.588369 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a2da-1e1c-444e-abc4-043bf3e52fff admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:48.588645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3a2da-1e1c-444e-abc4-043bf3e52fff admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:48.589470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3a2da-1e1c-444e-abc4-043bf3e52fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:16:48.589977 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3a2da-1e1c-444e-abc4-043bf3e52fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:48.592134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3a2da-1e1c-444e-abc4-043bf3e52fff admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:48.595888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b959672-050d-43c2-8057-e674bde3ba24 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:48.598657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:48.599510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:48.599790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:48.600098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] PATH_INFO: `/v3/projects/100dbc2826334855bcbc56c59c6d9fea` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:48.601661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] RBAC: Authorizing `identity:delete_project(project_id=100dbc2826334855bcbc56c59c6d9fea)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:48.603614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:48.609916 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1263/2513] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:16:48.610945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3a2da-1e1c-444e-abc4-043bf3e52fff admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:48.621975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3a2da-1e1c-444e-abc4-043bf3e52fff admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:48.627342 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc846-9868-431a-9aa7-09b67c8e7c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:48.628126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc846-9868-431a-9aa7-09b67c8e7c13 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:48.628408 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc846-9868-431a-9aa7-09b67c8e7c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:48.628683 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68dc846-9868-431a-9aa7-09b67c8e7c13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:48.629376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dc846-9868-431a-9aa7-09b67c8e7c13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:48.631278 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68dc846-9868-431a-9aa7-09b67c8e7c13 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:48.715759 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:48.725099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '100dbc2826334855bcbc56c59c6d9fea', 'request_id': 'req-3c6dad89-7f54-4629-aeb5-fb3d32a854be'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:48.731226 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '100dbc2826334855bcbc56c59c6d9fea', 'request_id': 'req-3c6dad89-7f54-4629-aeb5-fb3d32a854be'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:48.794461 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1264/2514] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:48 2022] POST /identity/v3/projects => generated 381 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:48.798971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc846-9868-431a-9aa7-09b67c8e7c13 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:48.815211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '100dbc2826334855bcbc56c59c6d9fea', 'request_id': 'req-3c6dad89-7f54-4629-aeb5-fb3d32a854be'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:48.818653 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:48.827942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] The token cache is being invalidate because project 100dbc2826334855bcbc56c59c6d9fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:48.828248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:48.829024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:48.830606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1251/2515] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:48 2022] DELETE /identity/v3/projects/100dbc2826334855bcbc56c59c6d9fea => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:48.834751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:48.836239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:48.862218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68dc846-9868-431a-9aa7-09b67c8e7c13 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:48.866921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458e32c-bc82-4b76-b52b-8b0205b6c360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:48.867589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458e32c-bc82-4b76-b52b-8b0205b6c360 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:48.867873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458e32c-bc82-4b76-b52b-8b0205b6c360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:48.868181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458e32c-bc82-4b76-b52b-8b0205b6c360 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:48.868865 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458e32c-bc82-4b76-b52b-8b0205b6c360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:48.870803 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458e32c-bc82-4b76-b52b-8b0205b6c360 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:48.906715 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6dad89-7f54-4629-aeb5-fb3d32a854be admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:48.912065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:48.912993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:48.913271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:48.913543 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] PATH_INFO: `/v3/users/5072f317531b430aa6c384518987bdb0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:48.914743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=5072f317531b430aa6c384518987bdb0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:48.916967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:49.023808 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1265/2516] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:48 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:49.028783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458e32c-bc82-4b76-b52b-8b0205b6c360 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:49.030462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-e458e32c-bc82-4b76-b52b-8b0205b6c360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:49.042946 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458e32c-bc82-4b76-b52b-8b0205b6c360 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:49.047908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06133a-d521-4e32-a3f9-84e7fde85700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:49.048601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06133a-d521-4e32-a3f9-84e7fde85700 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:49.048885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06133a-d521-4e32-a3f9-84e7fde85700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:49.049164 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06133a-d521-4e32-a3f9-84e7fde85700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:49.049889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06133a-d521-4e32-a3f9-84e7fde85700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:49.051470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa06133a-d521-4e32-a3f9-84e7fde85700 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:49.061794 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1266/2517] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:49.065586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06133a-d521-4e32-a3f9-84e7fde85700 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:49.076113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa06133a-d521-4e32-a3f9-84e7fde85700 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:49.080991 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1704ee-7807-4737-ae63-d22b9c1fc2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:49.081618 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1704ee-7807-4737-ae63-d22b9c1fc2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:49.081899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1704ee-7807-4737-ae63-d22b9c1fc2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:49.082176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1704ee-7807-4737-ae63-d22b9c1fc2c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:49.082920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1704ee-7807-4737-ae63-d22b9c1fc2c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:49.084478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1704ee-7807-4737-ae63-d22b9c1fc2c9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:49.096659 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1267/2518] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:49.100681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1704ee-7807-4737-ae63-d22b9c1fc2c9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:49.110855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1704ee-7807-4737-ae63-d22b9c1fc2c9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:49.116245 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512ac0e-49c0-43ee-86d0-fde299bb2f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:49.117184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ac0e-49c0-43ee-86d0-fde299bb2f9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:49.117462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ac0e-49c0-43ee-86d0-fde299bb2f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:49.117738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512ac0e-49c0-43ee-86d0-fde299bb2f9c admin admin] PATH_INFO: `/v3/projects/abbc87c2895644a2add03fc030acf243/users/fa8bbcc36b644571a301df6fdddf3f0f/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:49.133014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512ac0e-49c0-43ee-86d0-fde299bb2f9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=abbc87c2895644a2add03fc030acf243, user_id=fa8bbcc36b644571a301df6fdddf3f0f, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:49.135633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512ac0e-49c0-43ee-86d0-fde299bb2f9c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:49.192343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5072f317531b430aa6c384518987bdb0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:49.201924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1268/2519] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:49 2022] PUT /identity/v3/projects/abbc87c2895644a2add03fc030acf243/users/fa8bbcc36b644571a301df6fdddf3f0f/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:49.210241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5072f317531b430aa6c384518987bdb0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:49.212459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236db44-ebd7-4cfb-9753-8d7f36f17337 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:49.212751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236db44-ebd7-4cfb-9753-8d7f36f17337 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:49.213063 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7236db44-ebd7-4cfb-9753-8d7f36f17337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:49.213771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5072f317531b430aa6c384518987bdb0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:49.214505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5072f317531b430aa6c384518987bdb0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:49.215864 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5072f317531b430aa6c384518987bdb0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:49.239855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7236db44-ebd7-4cfb-9753-8d7f36f17337 None None] MFA Rules not processed for user `fa8bbcc36b644571a301df6fdddf3f0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:49.241099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7236db44-ebd7-4cfb-9753-8d7f36f17337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:49.292206 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1252/2520] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:48 2022] DELETE /identity/v3/users/5072f317531b430aa6c384518987bdb0 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:49.313603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1269/2521] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:16:49.318231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:49.319816 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:49.369774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:49.389891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921c209-e79f-4842-b47e-097fbceee2ff admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:49.394635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6523e-0360-4993-be1b-98f0d74791aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:49.395297 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6523e-0360-4993-be1b-98f0d74791aa admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:49.395580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6523e-0360-4993-be1b-98f0d74791aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:49.395854 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6523e-0360-4993-be1b-98f0d74791aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:49.396600 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6523e-0360-4993-be1b-98f0d74791aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:49.398516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6523e-0360-4993-be1b-98f0d74791aa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:49.502469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1253/2522] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:49 2022] POST /identity/v3/projects => generated 381 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:49.506907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236db44-ebd7-4cfb-9753-8d7f36f17337 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:49.566523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:49.578738 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7236db44-ebd7-4cfb-9753-8d7f36f17337 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:49.638931 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd078ab-3f48-4f97-8bba-0eae87f77935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:49.639607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd078ab-3f48-4f97-8bba-0eae87f77935 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:49.639886 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd078ab-3f48-4f97-8bba-0eae87f77935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:49.640192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd078ab-3f48-4f97-8bba-0eae87f77935 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:49.640895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd078ab-3f48-4f97-8bba-0eae87f77935 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:49.642859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd078ab-3f48-4f97-8bba-0eae87f77935 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:49.737410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6523e-0360-4993-be1b-98f0d74791aa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:49.739194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-39b6523e-0360-4993-be1b-98f0d74791aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:49.753438 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6523e-0360-4993-be1b-98f0d74791aa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:49.758337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:49.759230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:49.759516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:49.759980 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] PATH_INFO: `/v3/projects/02606cf6caca4fa9a9408205b5849fa0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:49.763053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02606cf6caca4fa9a9408205b5849fa0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:49.765229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:49.779768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1270/2523] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:49 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:49.783620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd078ab-3f48-4f97-8bba-0eae87f77935 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:49.794466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd078ab-3f48-4f97-8bba-0eae87f77935 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:49.799255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a5955-4e7f-4fa4-b38b-5b44475af838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:49.799904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a5955-4e7f-4fa4-b38b-5b44475af838 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:49.800207 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a5955-4e7f-4fa4-b38b-5b44475af838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:49.800482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a5955-4e7f-4fa4-b38b-5b44475af838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:49.801202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a5955-4e7f-4fa4-b38b-5b44475af838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:49.802822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a5955-4e7f-4fa4-b38b-5b44475af838 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:49.814907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1271/2524] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:49.819300 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a5955-4e7f-4fa4-b38b-5b44475af838 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:49.831584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a5955-4e7f-4fa4-b38b-5b44475af838 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:49.837212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a322-08ad-413d-ad19-202761d86263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:49.838237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a322-08ad-413d-ad19-202761d86263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:49.842976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a322-08ad-413d-ad19-202761d86263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:49.842976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a36a322-08ad-413d-ad19-202761d86263 admin admin] PATH_INFO: `/v3/projects/2bea06ef50894d408f58439aa0bf787f/users/babad034128f48f9b9bebb443564cb8a/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:49.855349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36a322-08ad-413d-ad19-202761d86263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bea06ef50894d408f58439aa0bf787f, user_id=babad034128f48f9b9bebb443564cb8a, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:49.858367 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a36a322-08ad-413d-ad19-202761d86263 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:49.970989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1272/2525] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:49 2022] PUT /identity/v3/projects/2bea06ef50894d408f58439aa0bf787f/users/babad034128f48f9b9bebb443564cb8a/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:49.974667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a322-08ad-413d-ad19-202761d86263 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:49.980771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02606cf6caca4fa9a9408205b5849fa0', 'request_id': 'req-0e851c02-1619-4834-bd27-2482d06e02b7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:49.987290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02606cf6caca4fa9a9408205b5849fa0', 'request_id': 'req-0e851c02-1619-4834-bd27-2482d06e02b7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:50.042316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a36a322-08ad-413d-ad19-202761d86263 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:50.099180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04ef8d-1b02-4f05-999b-753c5191f0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:50.099773 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ef8d-1b02-4f05-999b-753c5191f0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:50.100096 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ef8d-1b02-4f05-999b-753c5191f0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:50.100374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ef8d-1b02-4f05-999b-753c5191f0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:50.101104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04ef8d-1b02-4f05-999b-753c5191f0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:50.102795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04ef8d-1b02-4f05-999b-753c5191f0d3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:50.104193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:50.111789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02606cf6caca4fa9a9408205b5849fa0', 'request_id': 'req-0e851c02-1619-4834-bd27-2482d06e02b7'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:50.113426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1273/2526] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:50.125332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] The token cache is being invalidate because project 02606cf6caca4fa9a9408205b5849fa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:50.125617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:50.135032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:50.135032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1254/2527] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:49 2022] DELETE /identity/v3/projects/02606cf6caca4fa9a9408205b5849fa0 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:50.138420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04ef8d-1b02-4f05-999b-753c5191f0d3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:50.138637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:50.140512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:50.140963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-db04ef8d-1b02-4f05-999b-753c5191f0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:50.153974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04ef8d-1b02-4f05-999b-753c5191f0d3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:50.156689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e851c02-1619-4834-bd27-2482d06e02b7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:50.160060 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c3b889-6b06-4784-af16-7a732965c1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:50.160948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b889-6b06-4784-af16-7a732965c1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:50.161223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b889-6b06-4784-af16-7a732965c1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:50.161448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:50.161576 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c3b889-6b06-4784-af16-7a732965c1d5 admin admin] PATH_INFO: `/v3/projects/2bea06ef50894d408f58439aa0bf787f/users/babad034128f48f9b9bebb443564cb8a/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:50.162335 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:50.162618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:50.162897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] PATH_INFO: `/v3/users/3dc841fcc2b646268a138acd61a2d9be` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:50.163445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b889-6b06-4784-af16-7a732965c1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2bea06ef50894d408f58439aa0bf787f, user_id=babad034128f48f9b9bebb443564cb8a, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:50.164121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc841fcc2b646268a138acd61a2d9be)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:50.166091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c3b889-6b06-4784-af16-7a732965c1d5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:50.166221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:50.177874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1274/2528] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:50 2022] PUT /identity/v3/projects/2bea06ef50894d408f58439aa0bf787f/users/babad034128f48f9b9bebb443564cb8a/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:50.190404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fc2b3-e6d9-4f2b-a6cb-1734aa17d97c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:50.190688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fc2b3-e6d9-4f2b-a6cb-1734aa17d97c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:50.190964 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7fc2b3-e6d9-4f2b-a6cb-1734aa17d97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:50.218787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3d7fc2b3-e6d9-4f2b-a6cb-1734aa17d97c None None] MFA Rules not processed for user `babad034128f48f9b9bebb443564cb8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:50.220027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3d7fc2b3-e6d9-4f2b-a6cb-1734aa17d97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:50.287636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1275/2529] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:50 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:16:50.298846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fc2b3-e6d9-4f2b-a6cb-1734aa17d97c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:50.300246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3d7fc2b3-e6d9-4f2b-a6cb-1734aa17d97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:50.357625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7fc2b3-e6d9-4f2b-a6cb-1734aa17d97c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:50.361236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46062-9081-473b-8bb4-885838274914 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:50.361883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46062-9081-473b-8bb4-885838274914 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:50.362167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46062-9081-473b-8bb4-885838274914 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:50.362444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d46062-9081-473b-8bb4-885838274914 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:50.372543 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46062-9081-473b-8bb4-885838274914 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:50.373971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d46062-9081-473b-8bb4-885838274914 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:50.383631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1276/2530] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:16:50.447020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc841fcc2b646268a138acd61a2d9be'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:50.459738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc841fcc2b646268a138acd61a2d9be'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:50.467215 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc841fcc2b646268a138acd61a2d9be'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:50.467990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc841fcc2b646268a138acd61a2d9be'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:50.468631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc841fcc2b646268a138acd61a2d9be'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:50.649683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1255/2531] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:50 2022] DELETE /identity/v3/users/3dc841fcc2b646268a138acd61a2d9be => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:51.045805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46062-9081-473b-8bb4-885838274914 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:51.109665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d46062-9081-473b-8bb4-885838274914 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:51.121816 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:51.166765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:51.167541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:51.168654 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:51.168940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] PATH_INFO: `/v3/users/fa8bbcc36b644571a301df6fdddf3f0f` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:51.170120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8bbcc36b644571a301df6fdddf3f0f)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:51.172132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:51.185290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:51.186832 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:51.202575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee98b30-857b-43c5-83e8-d2791dc4193e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:51.207498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:51.208400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:51.208710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:51.208964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] PATH_INFO: `/v3/projects/bd58838cfa3c48fdbe8c9dce9ac013ae` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:51.210186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd58838cfa3c48fdbe8c9dce9ac013ae)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:51.212152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:51.231185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=80,keystone:INSERT=3,keystone:DELETE=17 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:51.453464 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd58838cfa3c48fdbe8c9dce9ac013ae', 'request_id': 'req-608be99e-0b21-4390-b393-ef137e9c1d3d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:51.454111 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8bbcc36b644571a301df6fdddf3f0f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:51.460655 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd58838cfa3c48fdbe8c9dce9ac013ae', 'request_id': 'req-608be99e-0b21-4390-b393-ef137e9c1d3d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:51.543452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8bbcc36b644571a301df6fdddf3f0f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:51.551395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8bbcc36b644571a301df6fdddf3f0f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:51.552142 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8bbcc36b644571a301df6fdddf3f0f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:51.564788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-4f806f3c-104a-40b7-bb6c-2c219313f9a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8bbcc36b644571a301df6fdddf3f0f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:51.570897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1277/2532] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:51 2022] DELETE /identity/v3/users/fa8bbcc36b644571a301df6fdddf3f0f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:51.576317 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcec2a-30e0-428d-8024-89ab8bee48a3 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:51.576612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcec2a-30e0-428d-8024-89ab8bee48a3 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:51.576894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcec2a-30e0-428d-8024-89ab8bee48a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:51.594472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d8bcec2a-30e0-428d-8024-89ab8bee48a3 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:51.595678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d8bcec2a-30e0-428d-8024-89ab8bee48a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:51.631908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd58838cfa3c48fdbe8c9dce9ac013ae', 'request_id': 'req-608be99e-0b21-4390-b393-ef137e9c1d3d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:51.644905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] The token cache is being invalidate because project bd58838cfa3c48fdbe8c9dce9ac013ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:51.645245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:51.645891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-608be99e-0b21-4390-b393-ef137e9c1d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:51.647423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1256/2533] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:51 2022] DELETE /identity/v3/projects/bd58838cfa3c48fdbe8c9dce9ac013ae => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:51.653862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec8249-ee70-4c00-b1f5-4f8252551916 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:51.654146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec8249-ee70-4c00-b1f5-4f8252551916 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:51.654510 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cec8249-ee70-4c00-b1f5-4f8252551916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:51.655811 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1278/2534] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:16:51.665902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcec2a-30e0-428d-8024-89ab8bee48a3 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:51.670305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d8bcec2a-30e0-428d-8024-89ab8bee48a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:51.674285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3cec8249-ee70-4c00-b1f5-4f8252551916 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:51.675492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3cec8249-ee70-4c00-b1f5-4f8252551916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:51.684886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1257/2535] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:51.693188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77949be-6ab8-4f2b-9381-40519b656513 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:51.693446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77949be-6ab8-4f2b-9381-40519b656513 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:51.693889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77949be-6ab8-4f2b-9381-40519b656513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:51.711548 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d77949be-6ab8-4f2b-9381-40519b656513 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:51.712708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d77949be-6ab8-4f2b-9381-40519b656513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:51.717298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:51.722937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1258/2536] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:16:51.727086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77949be-6ab8-4f2b-9381-40519b656513 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:51.733405 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcec2a-30e0-428d-8024-89ab8bee48a3 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:51.736530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77949be-6ab8-4f2b-9381-40519b656513 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:51.737282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735f7a4-6be5-4873-b1fe-936a616b96bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:51.737935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735f7a4-6be5-4873-b1fe-936a616b96bc service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:51.738218 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735f7a4-6be5-4873-b1fe-936a616b96bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:51.738494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3735f7a4-6be5-4873-b1fe-936a616b96bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:51.742786 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28046197-41db-4d05-b185-3cb64bee657f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:51.743444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046197-41db-4d05-b185-3cb64bee657f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:51.743722 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046197-41db-4d05-b185-3cb64bee657f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:51.744075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28046197-41db-4d05-b185-3cb64bee657f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:51.744805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28046197-41db-4d05-b185-3cb64bee657f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:16:51.745108 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28046197-41db-4d05-b185-3cb64bee657f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:51.746804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28046197-41db-4d05-b185-3cb64bee657f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:51.748546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735f7a4-6be5-4873-b1fe-936a616b96bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:51.749987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3735f7a4-6be5-4873-b1fe-936a616b96bc service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:51.759169 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1259/2537] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:16:51.760601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1279/2538] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:16:51.763943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28046197-41db-4d05-b185-3cb64bee657f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:51.774153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28046197-41db-4d05-b185-3cb64bee657f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:51.779490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa7254-f002-4f12-8603-be05b8edc8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:51.780247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7254-f002-4f12-8603-be05b8edc8d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:51.780524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7254-f002-4f12-8603-be05b8edc8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:51.780800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa7254-f002-4f12-8603-be05b8edc8d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:51.781496 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa7254-f002-4f12-8603-be05b8edc8d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:51.783437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa7254-f002-4f12-8603-be05b8edc8d4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:51.912454 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1260/2539] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:51 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:51.917012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735f7a4-6be5-4873-b1fe-936a616b96bc service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:51.927777 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3735f7a4-6be5-4873-b1fe-936a616b96bc service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.005581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e354e67-866e-4805-b818-444728041371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.010231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354e67-866e-4805-b818-444728041371 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.010231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354e67-866e-4805-b818-444728041371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.010231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e354e67-866e-4805-b818-444728041371 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.010231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e354e67-866e-4805-b818-444728041371 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:52.010231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e354e67-866e-4805-b818-444728041371 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:52.088240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa7254-f002-4f12-8603-be05b8edc8d4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:52.090728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-31fa7254-f002-4f12-8603-be05b8edc8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:52.138750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1280/2540] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:51 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:52.139878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e354e67-866e-4805-b818-444728041371 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:52.151437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e354e67-866e-4805-b818-444728041371 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.162727 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659d735-5be9-4bd2-a543-b0531ffa3226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.166202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659d735-5be9-4bd2-a543-b0531ffa3226 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.166202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659d735-5be9-4bd2-a543-b0531ffa3226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.166202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659d735-5be9-4bd2-a543-b0531ffa3226 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.166202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659d735-5be9-4bd2-a543-b0531ffa3226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:52.166780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659d735-5be9-4bd2-a543-b0531ffa3226 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:52.179287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1281/2541] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:52.183982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659d735-5be9-4bd2-a543-b0531ffa3226 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:52.190299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa7254-f002-4f12-8603-be05b8edc8d4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.194320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659d735-5be9-4bd2-a543-b0531ffa3226 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.197650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68250c8-d727-4eee-8b45-2cfaddcfa83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.198533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68250c8-d727-4eee-8b45-2cfaddcfa83b service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.198933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68250c8-d727-4eee-8b45-2cfaddcfa83b service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.199269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68250c8-d727-4eee-8b45-2cfaddcfa83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.199383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7e11c-526f-4b2a-8d9a-38c24ad19045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.200039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7e11c-526f-4b2a-8d9a-38c24ad19045 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.200376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7e11c-526f-4b2a-8d9a-38c24ad19045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.200591 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7e11c-526f-4b2a-8d9a-38c24ad19045 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.206565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7e11c-526f-4b2a-8d9a-38c24ad19045 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:52.206763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d68250c8-d727-4eee-8b45-2cfaddcfa83b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:52.206909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7e11c-526f-4b2a-8d9a-38c24ad19045 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:52.214227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1282/2542] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:52.218754 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7e11c-526f-4b2a-8d9a-38c24ad19045 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:52.228906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7e11c-526f-4b2a-8d9a-38c24ad19045 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.234878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a47445-c086-4c46-a4b0-fe9cd489c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.235996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a47445-c086-4c46-a4b0-fe9cd489c377 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.236274 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a47445-c086-4c46-a4b0-fe9cd489c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.236542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a47445-c086-4c46-a4b0-fe9cd489c377 admin admin] PATH_INFO: `/v3/projects/6681e7a7ff8f4f319b40f8ec6ff3b5e3/users/bab38d7d3c3541b7bae9773e120c45e8/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.258729 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a47445-c086-4c46-a4b0-fe9cd489c377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6681e7a7ff8f4f319b40f8ec6ff3b5e3, user_id=bab38d7d3c3541b7bae9773e120c45e8, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:52.261615 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a47445-c086-4c46-a4b0-fe9cd489c377 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:52.271286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:52.278365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68250c8-d727-4eee-8b45-2cfaddcfa83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:52.280171 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68250c8-d727-4eee-8b45-2cfaddcfa83b service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:52.289720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1261/2543] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:16:52.290589 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68250c8-d727-4eee-8b45-2cfaddcfa83b service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:52.292114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d68250c8-d727-4eee-8b45-2cfaddcfa83b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:52.305562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68250c8-d727-4eee-8b45-2cfaddcfa83b service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.312388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.313245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.313521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.316323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] PATH_INFO: `/v3/projects/abbc87c2895644a2add03fc030acf243` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.316323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abbc87c2895644a2add03fc030acf243)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:52.316875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:52.401198 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1283/2544] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:52 2022] PUT /identity/v3/projects/6681e7a7ff8f4f319b40f8ec6ff3b5e3/users/bab38d7d3c3541b7bae9773e120c45e8/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:52.412963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bf312-ac8c-491e-874b-124e2c0e36af None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.413265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bf312-ac8c-491e-874b-124e2c0e36af None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.413542 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bf312-ac8c-491e-874b-124e2c0e36af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.442898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-3f8bf312-ac8c-491e-874b-124e2c0e36af None None] MFA Rules not processed for user `bab38d7d3c3541b7bae9773e120c45e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:52.444339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3f8bf312-ac8c-491e-874b-124e2c0e36af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:52.459709 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abbc87c2895644a2add03fc030acf243', 'request_id': 'req-71e269d1-030c-45e9-9fc9-cda1b42e8053'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:52.467012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abbc87c2895644a2add03fc030acf243', 'request_id': 'req-71e269d1-030c-45e9-9fc9-cda1b42e8053'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:52.512558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1284/2545] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:16:52.517026 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bf312-ac8c-491e-874b-124e2c0e36af None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:52.530580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:52.577562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abbc87c2895644a2add03fc030acf243', 'request_id': 'req-71e269d1-030c-45e9-9fc9-cda1b42e8053'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:52.579640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bf312-ac8c-491e-874b-124e2c0e36af None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.584806 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553a50-38be-451e-9d54-79fdbb894a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.585521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553a50-38be-451e-9d54-79fdbb894a3d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.585887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553a50-38be-451e-9d54-79fdbb894a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.586166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa553a50-38be-451e-9d54-79fdbb894a3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.586868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa553a50-38be-451e-9d54-79fdbb894a3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:52.588851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa553a50-38be-451e-9d54-79fdbb894a3d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:52.592883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] The token cache is being invalidate because project abbc87c2895644a2add03fc030acf243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:52.593243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:52.594008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:52.598672 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1262/2546] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:52 2022] DELETE /identity/v3/projects/abbc87c2895644a2add03fc030acf243 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:52.599641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:52.601125 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:52.614822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e269d1-030c-45e9-9fc9-cda1b42e8053 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.619970 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.620940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.631542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.631542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] PATH_INFO: `/v3/users/babad034128f48f9b9bebb443564cb8a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.631542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=babad034128f48f9b9bebb443564cb8a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:52.631542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:52.729132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1285/2547] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:52 2022] POST /identity/v3/projects => generated 381 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:52.733723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553a50-38be-451e-9d54-79fdbb894a3d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:52.735426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-aa553a50-38be-451e-9d54-79fdbb894a3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:52.799310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa553a50-38be-451e-9d54-79fdbb894a3d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.803814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd98be-23f6-4c15-8c7a-5b61b04709bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.804511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd98be-23f6-4c15-8c7a-5b61b04709bd admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.804789 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd98be-23f6-4c15-8c7a-5b61b04709bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.805061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd98be-23f6-4c15-8c7a-5b61b04709bd admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.805747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd98be-23f6-4c15-8c7a-5b61b04709bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:52.807652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd98be-23f6-4c15-8c7a-5b61b04709bd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:52.863721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'babad034128f48f9b9bebb443564cb8a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:52.876449 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'babad034128f48f9b9bebb443564cb8a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:52.883412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'babad034128f48f9b9bebb443564cb8a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:52.884273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'babad034128f48f9b9bebb443564cb8a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:52.884894 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'babad034128f48f9b9bebb443564cb8a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:52.914688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1286/2548] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:52 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:52.917010 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd98be-23f6-4c15-8c7a-5b61b04709bd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:52.919227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ffbd98be-23f6-4c15-8c7a-5b61b04709bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:52.932291 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd98be-23f6-4c15-8c7a-5b61b04709bd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.937395 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f57dd-c7da-4c6c-8fbd-a6ec2d8105e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.944220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f57dd-c7da-4c6c-8fbd-a6ec2d8105e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.944220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f57dd-c7da-4c6c-8fbd-a6ec2d8105e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.944220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f57dd-c7da-4c6c-8fbd-a6ec2d8105e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:52.944220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f57dd-c7da-4c6c-8fbd-a6ec2d8105e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:52.944220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f57dd-c7da-4c6c-8fbd-a6ec2d8105e9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:52.954739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1287/2549] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:52.963268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f57dd-c7da-4c6c-8fbd-a6ec2d8105e9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:52.976382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f57dd-c7da-4c6c-8fbd-a6ec2d8105e9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:52.981604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020abff-a3d1-43ba-8e45-8cf8e37b408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:52.982563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020abff-a3d1-43ba-8e45-8cf8e37b408c admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:52.982776 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020abff-a3d1-43ba-8e45-8cf8e37b408c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:52.983037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020abff-a3d1-43ba-8e45-8cf8e37b408c admin admin] PATH_INFO: `/v3/projects/24d073ba09a047a28929b526ddd3a126/users/f05dc57817484c5cb81846681b351e10/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:53.000484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020abff-a3d1-43ba-8e45-8cf8e37b408c admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d073ba09a047a28929b526ddd3a126, user_id=f05dc57817484c5cb81846681b351e10, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:53.004889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2020abff-a3d1-43ba-8e45-8cf8e37b408c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:53.014130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1263/2550] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:52 2022] DELETE /identity/v3/users/babad034128f48f9b9bebb443564cb8a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:53.097691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1288/2551] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:52 2022] PUT /identity/v3/projects/24d073ba09a047a28929b526ddd3a126/users/f05dc57817484c5cb81846681b351e10/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:53.102058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:53.155979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:53.170301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9872c4a-5d80-40de-b3a2-3a0ec9b094f5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:53.231046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42807f70-b62f-4914-829b-a05a591bb4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:53.231719 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42807f70-b62f-4914-829b-a05a591bb4db admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:53.232028 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42807f70-b62f-4914-829b-a05a591bb4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:53.232349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42807f70-b62f-4914-829b-a05a591bb4db admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:53.233074 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42807f70-b62f-4914-829b-a05a591bb4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:53.235245 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42807f70-b62f-4914-829b-a05a591bb4db admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:53.245492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1264/2552] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:53.251145 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020abff-a3d1-43ba-8e45-8cf8e37b408c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:53.262581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020abff-a3d1-43ba-8e45-8cf8e37b408c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:53.269941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e9d49-48f9-4a9c-897f-9df4f4140ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:53.270961 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e9d49-48f9-4a9c-897f-9df4f4140ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:53.271240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e9d49-48f9-4a9c-897f-9df4f4140ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:53.271545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974e9d49-48f9-4a9c-897f-9df4f4140ca4 admin admin] PATH_INFO: `/v3/projects/24d073ba09a047a28929b526ddd3a126/users/f05dc57817484c5cb81846681b351e10/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:53.273575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e9d49-48f9-4a9c-897f-9df4f4140ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24d073ba09a047a28929b526ddd3a126, user_id=f05dc57817484c5cb81846681b351e10, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:53.276233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974e9d49-48f9-4a9c-897f-9df4f4140ca4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:53.287688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1289/2553] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:53 2022] PUT /identity/v3/projects/24d073ba09a047a28929b526ddd3a126/users/f05dc57817484c5cb81846681b351e10/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:53.305113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21947ab6-0c43-47fd-bfda-f19b0464548d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:53.305646 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21947ab6-0c43-47fd-bfda-f19b0464548d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:53.306321 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21947ab6-0c43-47fd-bfda-f19b0464548d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:53.335436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-21947ab6-0c43-47fd-bfda-f19b0464548d None None] MFA Rules not processed for user `f05dc57817484c5cb81846681b351e10`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:53.336762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-21947ab6-0c43-47fd-bfda-f19b0464548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:53.412798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1265/2554] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:53 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:53.425467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e9d49-48f9-4a9c-897f-9df4f4140ca4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:53.427234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-974e9d49-48f9-4a9c-897f-9df4f4140ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:53.474561 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:53.488629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974e9d49-48f9-4a9c-897f-9df4f4140ca4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:53.492293 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ced4-999d-44a4-9dc7-3d8ed530f107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:53.492940 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ced4-999d-44a4-9dc7-3d8ed530f107 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:53.493223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ced4-999d-44a4-9dc7-3d8ed530f107 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:53.493500 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd2ced4-999d-44a4-9dc7-3d8ed530f107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:53.503555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2ced4-999d-44a4-9dc7-3d8ed530f107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:53.511014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd2ced4-999d-44a4-9dc7-3d8ed530f107 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:53.516238 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1290/2555] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:53 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:53.543906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21947ab6-0c43-47fd-bfda-f19b0464548d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:53.551661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-21947ab6-0c43-47fd-bfda-f19b0464548d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:53.629492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21947ab6-0c43-47fd-bfda-f19b0464548d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:53.634004 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:53.634873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:53.635152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:53.635426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] PATH_INFO: `/v3/projects/2bea06ef50894d408f58439aa0bf787f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:53.636821 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2bea06ef50894d408f58439aa0bf787f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:53.638752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:53.661880 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:53.675907 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ced4-999d-44a4-9dc7-3d8ed530f107 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:53.685390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd2ced4-999d-44a4-9dc7-3d8ed530f107 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:53.689309 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7e5b8-e5b0-47fe-99f3-8660804cef7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:53.689958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e5b8-e5b0-47fe-99f3-8660804cef7e service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:53.690241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e5b8-e5b0-47fe-99f3-8660804cef7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:53.690515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7e5b8-e5b0-47fe-99f3-8660804cef7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:53.692371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-69a7e5b8-e5b0-47fe-99f3-8660804cef7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:53.752124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7e5b8-e5b0-47fe-99f3-8660804cef7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:53.753570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7e5b8-e5b0-47fe-99f3-8660804cef7e service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:53.763418 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1291/2556] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:16:53.770523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2bea06ef50894d408f58439aa0bf787f', 'request_id': 'req-40520d04-f39f-4913-ac0a-b67165666f15'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:53.776024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2bea06ef50894d408f58439aa0bf787f', 'request_id': 'req-40520d04-f39f-4913-ac0a-b67165666f15'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:53.892126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2bea06ef50894d408f58439aa0bf787f', 'request_id': 'req-40520d04-f39f-4913-ac0a-b67165666f15'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:53.907790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] The token cache is being invalidate because project 2bea06ef50894d408f58439aa0bf787f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:53.908128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:53.908783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-40520d04-f39f-4913-ac0a-b67165666f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:53.910316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1266/2557] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:53 2022] DELETE /identity/v3/projects/2bea06ef50894d408f58439aa0bf787f => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:53.915475 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b689d05-9b52-41ea-81b4-7267f83a2713 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:53.915856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b689d05-9b52-41ea-81b4-7267f83a2713 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:53.916253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b689d05-9b52-41ea-81b4-7267f83a2713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:53.940272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7b689d05-9b52-41ea-81b4-7267f83a2713 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:53.941637 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7b689d05-9b52-41ea-81b4-7267f83a2713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:54.020238 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1292/2558] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:54.025597 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3649b-bb6a-4601-87b4-6d155887e8e5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.025892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3649b-bb6a-4601-87b4-6d155887e8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.026177 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e3649b-bb6a-4601-87b4-6d155887e8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.048273 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-54e3649b-bb6a-4601-87b4-6d155887e8e5 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:54.049583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-54e3649b-bb6a-4601-87b4-6d155887e8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:54.057887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1267/2559] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:54.068388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b689d05-9b52-41ea-81b4-7267f83a2713 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:54.079504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b689d05-9b52-41ea-81b4-7267f83a2713 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:54.085303 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f88da-e5af-4005-bcf0-ff7013dc3ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:54.085984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f88da-e5af-4005-bcf0-ff7013dc3ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.086271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f88da-e5af-4005-bcf0-ff7013dc3ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.086549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f88da-e5af-4005-bcf0-ff7013dc3ce9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.087310 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f88da-e5af-4005-bcf0-ff7013dc3ce9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:16:54.087660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f88da-e5af-4005-bcf0-ff7013dc3ce9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:54.089892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f88da-e5af-4005-bcf0-ff7013dc3ce9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:54.102889 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1293/2560] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:16:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:16:54.109047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3649b-bb6a-4601-87b4-6d155887e8e5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:54.119259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e3649b-bb6a-4601-87b4-6d155887e8e5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:54.128541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36424bb-01bb-4b15-8877-0e34ac199774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:54.129238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36424bb-01bb-4b15-8877-0e34ac199774 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.129497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36424bb-01bb-4b15-8877-0e34ac199774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.129765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36424bb-01bb-4b15-8877-0e34ac199774 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.130475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36424bb-01bb-4b15-8877-0e34ac199774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:54.132628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36424bb-01bb-4b15-8877-0e34ac199774 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:54.254154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1268/2561] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:54 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:54.258563 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f88da-e5af-4005-bcf0-ff7013dc3ce9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:54.269462 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f88da-e5af-4005-bcf0-ff7013dc3ce9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:54.304710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36424bb-01bb-4b15-8877-0e34ac199774 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:54.306722 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d36424bb-01bb-4b15-8877-0e34ac199774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:54.336997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44526d-6fb3-4d60-971e-c2f6e378c577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:54.337589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44526d-6fb3-4d60-971e-c2f6e378c577 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.337873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44526d-6fb3-4d60-971e-c2f6e378c577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.338266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44526d-6fb3-4d60-971e-c2f6e378c577 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.338885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44526d-6fb3-4d60-971e-c2f6e378c577 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:54.342370 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44526d-6fb3-4d60-971e-c2f6e378c577 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:54.377472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36424bb-01bb-4b15-8877-0e34ac199774 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:54.382190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:54.383067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.383344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.383615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] PATH_INFO: `/v3/users/bab38d7d3c3541b7bae9773e120c45e8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.384853 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] RBAC: Authorizing `identity:delete_user(user_id=bab38d7d3c3541b7bae9773e120c45e8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:54.387274 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:54.489777 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:54.496172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1294/2562] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:54 2022] POST /identity/v3/users => generated 287 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:54.499986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44526d-6fb3-4d60-971e-c2f6e378c577 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:54.510056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44526d-6fb3-4d60-971e-c2f6e378c577 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:54.515892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c378f87-b711-49cc-893d-951f58d59b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:54.516580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c378f87-b711-49cc-893d-951f58d59b64 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.516975 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c378f87-b711-49cc-893d-951f58d59b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.518510 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c378f87-b711-49cc-893d-951f58d59b64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.519261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c378f87-b711-49cc-893d-951f58d59b64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:54.520893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c378f87-b711-49cc-893d-951f58d59b64 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:54.536188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1295/2563] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:16:54.540536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c378f87-b711-49cc-893d-951f58d59b64 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:54.551081 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c378f87-b711-49cc-893d-951f58d59b64 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:54.555699 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c463306-a9a7-448d-8a95-7596fb3fb749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:54.558541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c463306-a9a7-448d-8a95-7596fb3fb749 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.558541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c463306-a9a7-448d-8a95-7596fb3fb749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.558541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c463306-a9a7-448d-8a95-7596fb3fb749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.558541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c463306-a9a7-448d-8a95-7596fb3fb749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:54.559193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c463306-a9a7-448d-8a95-7596fb3fb749 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:54.569143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1296/2564] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:54.573387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c463306-a9a7-448d-8a95-7596fb3fb749 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:54.583391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c463306-a9a7-448d-8a95-7596fb3fb749 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:54.600645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566a221-2188-466b-b091-4bf98fb61341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:54.600645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a221-2188-466b-b091-4bf98fb61341 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.600645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a221-2188-466b-b091-4bf98fb61341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.600645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566a221-2188-466b-b091-4bf98fb61341 admin admin] PATH_INFO: `/v3/projects/e7a74766d4884512954e4099249b09f6/users/802568c5e1d2421f8be0f85a3ae59cde/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.604883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566a221-2188-466b-b091-4bf98fb61341 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7a74766d4884512954e4099249b09f6, user_id=802568c5e1d2421f8be0f85a3ae59cde, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:54.607652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f566a221-2188-466b-b091-4bf98fb61341 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:54.639757 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bab38d7d3c3541b7bae9773e120c45e8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:54.652935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bab38d7d3c3541b7bae9773e120c45e8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:54.660211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bab38d7d3c3541b7bae9773e120c45e8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:54.664402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bab38d7d3c3541b7bae9773e120c45e8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:54.664402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a2a5ed5c-6a19-42fb-88c4-7fd0bc9a0fec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bab38d7d3c3541b7bae9773e120c45e8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:54.723642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1297/2565] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:54 2022] PUT /identity/v3/projects/e7a74766d4884512954e4099249b09f6/users/802568c5e1d2421f8be0f85a3ae59cde/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:54.734099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4f7b1-c673-4c01-8e81-ea286875f5a6 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.734330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4f7b1-c673-4c01-8e81-ea286875f5a6 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.734611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a4f7b1-c673-4c01-8e81-ea286875f5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.758942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:54.765492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-06a4f7b1-c673-4c01-8e81-ea286875f5a6 None None] MFA Rules not processed for user `802568c5e1d2421f8be0f85a3ae59cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:54.766360 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1269/2566] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:54 2022] DELETE /identity/v3/users/bab38d7d3c3541b7bae9773e120c45e8 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:16:54.767345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-06a4f7b1-c673-4c01-8e81-ea286875f5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:54.770603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61258e9-0479-4b0b-9d83-920712b3b24e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.770887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61258e9-0479-4b0b-9d83-920712b3b24e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.771166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61258e9-0479-4b0b-9d83-920712b3b24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.788798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c61258e9-0479-4b0b-9d83-920712b3b24e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:54.790019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c61258e9-0479-4b0b-9d83-920712b3b24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:54.842227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1298/2567] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:16:54.856772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1270/2568] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:16:54.856979 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4f7b1-c673-4c01-8e81-ea286875f5a6 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:54.856979 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-06a4f7b1-c673-4c01-8e81-ea286875f5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:54.863355 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61258e9-0479-4b0b-9d83-920712b3b24e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:54.864891 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c61258e9-0479-4b0b-9d83-920712b3b24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:54.916765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a4f7b1-c673-4c01-8e81-ea286875f5a6 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:54.921108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33af60b-72d2-4083-8633-611462e65332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:54.921751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af60b-72d2-4083-8633-611462e65332 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.922033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af60b-72d2-4083-8633-611462e65332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.922307 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33af60b-72d2-4083-8633-611462e65332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.929441 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61258e9-0479-4b0b-9d83-920712b3b24e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:54.931173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33af60b-72d2-4083-8633-611462e65332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:54.932640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33af60b-72d2-4083-8633-611462e65332 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:54.933128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacb88f-8e43-4fbb-ad52-4fac717b1003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:54.934033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacb88f-8e43-4fbb-ad52-4fac717b1003 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:54.934240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacb88f-8e43-4fbb-ad52-4fac717b1003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:54.934524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeacb88f-8e43-4fbb-ad52-4fac717b1003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:54.941949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1299/2569] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:16:54.944053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacb88f-8e43-4fbb-ad52-4fac717b1003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:54.945580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeacb88f-8e43-4fbb-ad52-4fac717b1003 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:54.956521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1271/2570] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:16:55.457601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33af60b-72d2-4083-8633-611462e65332 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:55.457601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a33af60b-72d2-4083-8633-611462e65332 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:55.471966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33af60b-72d2-4083-8633-611462e65332 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:55.478882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:55.481876 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:55.482308 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:55.482819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] PATH_INFO: `/v3/projects/6681e7a7ff8f4f319b40f8ec6ff3b5e3` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:55.484966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6681e7a7ff8f4f319b40f8ec6ff3b5e3)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:55.488179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:55.633949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:55.640983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6681e7a7ff8f4f319b40f8ec6ff3b5e3', 'request_id': 'req-1f247a71-ad02-483c-91bf-46941b3f4e7b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:55.646537 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6681e7a7ff8f4f319b40f8ec6ff3b5e3', 'request_id': 'req-1f247a71-ad02-483c-91bf-46941b3f4e7b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:55.849050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6681e7a7ff8f4f319b40f8ec6ff3b5e3', 'request_id': 'req-1f247a71-ad02-483c-91bf-46941b3f4e7b'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:55.861614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] The token cache is being invalidate because project 6681e7a7ff8f4f319b40f8ec6ff3b5e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:55.861902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:55.862552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:55.864110 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1300/2571] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:55 2022] DELETE /identity/v3/projects/6681e7a7ff8f4f319b40f8ec6ff3b5e3 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:55.868244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacb88f-8e43-4fbb-ad52-4fac717b1003 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:55.877999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeacb88f-8e43-4fbb-ad52-4fac717b1003 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:55.942698 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:55.944922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:55.944922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:55.944922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] PATH_INFO: `/v3/users/f05dc57817484c5cb81846681b351e10` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:55.945554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f05dc57817484c5cb81846681b351e10)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:55.947726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:56.155617 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:56.158299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f05dc57817484c5cb81846681b351e10'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:56.170906 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f05dc57817484c5cb81846681b351e10'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:56.178007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f05dc57817484c5cb81846681b351e10'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:56.178741 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f05dc57817484c5cb81846681b351e10'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:56.179356 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-504b3f22-f2b3-4138-820f-e228d673c0f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f05dc57817484c5cb81846681b351e10'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:56.296519 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1272/2572] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:55 2022] DELETE /identity/v3/users/f05dc57817484c5cb81846681b351e10 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:56.806586 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:56.809569 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:56.828679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f247a71-ad02-483c-91bf-46941b3f4e7b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:56.924397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:56.928573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:56.928573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:56.928573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] PATH_INFO: `/v3/projects/24d073ba09a047a28929b526ddd3a126` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:56.928573 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24d073ba09a047a28929b526ddd3a126)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:56.929665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:57.070818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24d073ba09a047a28929b526ddd3a126', 'request_id': 'req-3b3d36dd-6e72-4116-8949-1b9a6750fc82'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:57.081671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24d073ba09a047a28929b526ddd3a126', 'request_id': 'req-3b3d36dd-6e72-4116-8949-1b9a6750fc82'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:57.242012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24d073ba09a047a28929b526ddd3a126', 'request_id': 'req-3b3d36dd-6e72-4116-8949-1b9a6750fc82'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:57.258785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] The token cache is being invalidate because project 24d073ba09a047a28929b526ddd3a126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:16:57.258785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:57.260223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-3b3d36dd-6e72-4116-8949-1b9a6750fc82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:57.263171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1301/2573] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:16:56 2022] DELETE /identity/v3/projects/24d073ba09a047a28929b526ddd3a126 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:57.268605 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f095b-d39a-4009-b0a8-6867d89d41c0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:57.269494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f095b-d39a-4009-b0a8-6867d89d41c0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:57.269974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f095b-d39a-4009-b0a8-6867d89d41c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:57.294843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bc1f095b-d39a-4009-b0a8-6867d89d41c0 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:57.298988 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bc1f095b-d39a-4009-b0a8-6867d89d41c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:57.374981 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1273/2574] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:57.383393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681369b-29cd-4f9a-947f-daf5622b2a19 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:57.383801 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681369b-29cd-4f9a-947f-daf5622b2a19 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:57.384174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681369b-29cd-4f9a-947f-daf5622b2a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:57.406275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6681369b-29cd-4f9a-947f-daf5622b2a19 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:57.406275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6681369b-29cd-4f9a-947f-daf5622b2a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:57.413660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1302/2575] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:16:57.418580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f095b-d39a-4009-b0a8-6867d89d41c0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:57.428232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f095b-d39a-4009-b0a8-6867d89d41c0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:57.432836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662ceaf-ac2e-43b3-bf1d-bd4b7f551f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:57.433765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662ceaf-ac2e-43b3-bf1d-bd4b7f551f5b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:57.434055 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662ceaf-ac2e-43b3-bf1d-bd4b7f551f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:57.434332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0662ceaf-ac2e-43b3-bf1d-bd4b7f551f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:57.435067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662ceaf-ac2e-43b3-bf1d-bd4b7f551f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:16:57.435763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662ceaf-ac2e-43b3-bf1d-bd4b7f551f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:57.437091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0662ceaf-ac2e-43b3-bf1d-bd4b7f551f5b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:57.452694 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1274/2576] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:16:57.458608 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681369b-29cd-4f9a-947f-daf5622b2a19 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:57.467840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681369b-29cd-4f9a-947f-daf5622b2a19 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:57.472703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da0828-54d2-4f2d-9989-f2139a8c215d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:57.473383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da0828-54d2-4f2d-9989-f2139a8c215d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:57.473661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da0828-54d2-4f2d-9989-f2139a8c215d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:57.473932 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da0828-54d2-4f2d-9989-f2139a8c215d admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:57.474635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da0828-54d2-4f2d-9989-f2139a8c215d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:57.476986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da0828-54d2-4f2d-9989-f2139a8c215d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:57.574887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1303/2577] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:16:57 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:16:57.578363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662ceaf-ac2e-43b3-bf1d-bd4b7f551f5b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:57.588378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0662ceaf-ac2e-43b3-bf1d-bd4b7f551f5b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:57.646252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06342-69f0-46be-b9ba-19dc2b2b53cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:57.646922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06342-69f0-46be-b9ba-19dc2b2b53cd admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:57.647309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06342-69f0-46be-b9ba-19dc2b2b53cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:57.647524 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e06342-69f0-46be-b9ba-19dc2b2b53cd admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:57.648278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06342-69f0-46be-b9ba-19dc2b2b53cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:57.650191 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e06342-69f0-46be-b9ba-19dc2b2b53cd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:57.806707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1275/2578] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:16:57 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:16:57.813709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da0828-54d2-4f2d-9989-f2139a8c215d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:57.824792 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da0828-54d2-4f2d-9989-f2139a8c215d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:57.829604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8b9c1-f306-4ccf-8409-a6365aab0f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:57.830299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8b9c1-f306-4ccf-8409-a6365aab0f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:57.830588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8b9c1-f306-4ccf-8409-a6365aab0f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:57.830882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8b9c1-f306-4ccf-8409-a6365aab0f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:57.831611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8b9c1-f306-4ccf-8409-a6365aab0f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:57.833330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8b9c1-f306-4ccf-8409-a6365aab0f38 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:57.844476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1304/2579] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:57.848886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06342-69f0-46be-b9ba-19dc2b2b53cd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:57.859936 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e06342-69f0-46be-b9ba-19dc2b2b53cd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:57.866857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9de842-5f7c-454f-acb7-06fc804ee0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:57.867527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9de842-5f7c-454f-acb7-06fc804ee0fd admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:57.867813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9de842-5f7c-454f-acb7-06fc804ee0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:57.868123 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9de842-5f7c-454f-acb7-06fc804ee0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:57.868858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9de842-5f7c-454f-acb7-06fc804ee0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:57.870489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9de842-5f7c-454f-acb7-06fc804ee0fd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:57.887429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1276/2580] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:16:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:16:57.891071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8b9c1-f306-4ccf-8409-a6365aab0f38 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:57.901365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8b9c1-f306-4ccf-8409-a6365aab0f38 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:57.906109 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dfed1-eabe-4954-9fb9-0f6f3297c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:57.907128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dfed1-eabe-4954-9fb9-0f6f3297c80b admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:57.907410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dfed1-eabe-4954-9fb9-0f6f3297c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:57.907980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dfed1-eabe-4954-9fb9-0f6f3297c80b admin admin] PATH_INFO: `/v3/projects/ac0e203ee82947e3a91b5f8f128a8406/users/2d4d46c5076148c7b30364e67c16070d/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:57.924386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dfed1-eabe-4954-9fb9-0f6f3297c80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac0e203ee82947e3a91b5f8f128a8406, user_id=2d4d46c5076148c7b30364e67c16070d, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:57.927389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dfed1-eabe-4954-9fb9-0f6f3297c80b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:57.929845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:58.061216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1305/2581] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:16:57 2022] PUT /identity/v3/projects/ac0e203ee82947e3a91b5f8f128a8406/users/2d4d46c5076148c7b30364e67c16070d/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:16:58.066488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d6b8e-8a20-4b03-afcb-58cbf18f407b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:58.066775 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d6b8e-8a20-4b03-afcb-58cbf18f407b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:58.067048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095d6b8e-8a20-4b03-afcb-58cbf18f407b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:58.087901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-095d6b8e-8a20-4b03-afcb-58cbf18f407b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:16:58.087901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-095d6b8e-8a20-4b03-afcb-58cbf18f407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:58.110301 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:16:58.154015 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1277/2582] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:16:58.163730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dfed1-eabe-4954-9fb9-0f6f3297c80b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:58.165509 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d58dfed1-eabe-4954-9fb9-0f6f3297c80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:58.232084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dfed1-eabe-4954-9fb9-0f6f3297c80b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:58.235533 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8fcf83-d40a-41c9-8c1d-2390b7732e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:58.237347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fcf83-d40a-41c9-8c1d-2390b7732e47 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:58.237347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fcf83-d40a-41c9-8c1d-2390b7732e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:58.237347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8fcf83-d40a-41c9-8c1d-2390b7732e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:58.247443 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fcf83-d40a-41c9-8c1d-2390b7732e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:58.248934 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8fcf83-d40a-41c9-8c1d-2390b7732e47 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:58.258650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1306/2583] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:16:59.550381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d6b8e-8a20-4b03-afcb-58cbf18f407b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:16:59.552084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-095d6b8e-8a20-4b03-afcb-58cbf18f407b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:16:59.565286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095d6b8e-8a20-4b03-afcb-58cbf18f407b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:16:59.569911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:16:59.570783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:16:59.571063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:16:59.571336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] PATH_INFO: `/v3/users/802568c5e1d2421f8be0f85a3ae59cde` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:16:59.572562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=802568c5e1d2421f8be0f85a3ae59cde)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:16:59.579089 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:16:59.843374 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '802568c5e1d2421f8be0f85a3ae59cde'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:59.857095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '802568c5e1d2421f8be0f85a3ae59cde'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:59.864902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '802568c5e1d2421f8be0f85a3ae59cde'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:59.865764 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '802568c5e1d2421f8be0f85a3ae59cde'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:16:59.866412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '802568c5e1d2421f8be0f85a3ae59cde'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:00.035319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1278/2584] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:16:59 2022] DELETE /identity/v3/users/802568c5e1d2421f8be0f85a3ae59cde => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:00.039862 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb94f-aae4-47b9-9f0c-7138fa66bef2 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:00.040348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb94f-aae4-47b9-9f0c-7138fa66bef2 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:00.040491 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfb94f-aae4-47b9-9f0c-7138fa66bef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:00.059812 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-49dfb94f-aae4-47b9-9f0c-7138fa66bef2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:00.061146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-49dfb94f-aae4-47b9-9f0c-7138fa66bef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:00.128717 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1307/2585] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:00.138415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:00.140639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:00.201416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec5e03-1902-4636-93be-4ce4f64a8941 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:00.204877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b2ea9-994d-4fb2-98a2-f9d242cae01d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:00.205520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b2ea9-994d-4fb2-98a2-f9d242cae01d service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:00.205802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b2ea9-994d-4fb2-98a2-f9d242cae01d service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:00.206076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b2ea9-994d-4fb2-98a2-f9d242cae01d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:00.215207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b2ea9-994d-4fb2-98a2-f9d242cae01d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:00.216782 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b2ea9-994d-4fb2-98a2-f9d242cae01d service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:00.226399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1279/2586] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:00.875471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb94f-aae4-47b9-9f0c-7138fa66bef2 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:00.877382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-49dfb94f-aae4-47b9-9f0c-7138fa66bef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:00.896900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfb94f-aae4-47b9-9f0c-7138fa66bef2 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:00.903610 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:00.904646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:00.905002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:00.906945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] PATH_INFO: `/v3/projects/e7a74766d4884512954e4099249b09f6` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:00.908103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7a74766d4884512954e4099249b09f6)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:00.922358 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:01.149688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7a74766d4884512954e4099249b09f6', 'request_id': 'req-46dbf960-a6d4-41ef-a092-f96259a16d00'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:01.156161 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7a74766d4884512954e4099249b09f6', 'request_id': 'req-46dbf960-a6d4-41ef-a092-f96259a16d00'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:01.225818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7a74766d4884512954e4099249b09f6', 'request_id': 'req-46dbf960-a6d4-41ef-a092-f96259a16d00'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:01.239624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] The token cache is being invalidate because project e7a74766d4884512954e4099249b09f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:01.240130 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:01.240794 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-46dbf960-a6d4-41ef-a092-f96259a16d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:01.242627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1308/2587] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:00 2022] DELETE /identity/v3/projects/e7a74766d4884512954e4099249b09f6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:01.248784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ce4e5-d8ca-4e46-bb41-1166e1ccd858 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:01.249279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ce4e5-d8ca-4e46-bb41-1166e1ccd858 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:01.249394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909ce4e5-d8ca-4e46-bb41-1166e1ccd858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:01.269146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-909ce4e5-d8ca-4e46-bb41-1166e1ccd858 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:01.270377 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-909ce4e5-d8ca-4e46-bb41-1166e1ccd858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:01.314012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:01.344680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1280/2588] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:17:01.350706 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d42fb-e7e2-4246-97e8-c7156d88ab67 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:01.350989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d42fb-e7e2-4246-97e8-c7156d88ab67 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:01.351264 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d42fb-e7e2-4246-97e8-c7156d88ab67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:01.386065 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-846d42fb-e7e2-4246-97e8-c7156d88ab67 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:01.388514 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-846d42fb-e7e2-4246-97e8-c7156d88ab67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:01.399964 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1309/2589] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:01.408157 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ce4e5-d8ca-4e46-bb41-1166e1ccd858 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:01.417345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909ce4e5-d8ca-4e46-bb41-1166e1ccd858 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:01.423108 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83efbe0-ebe5-417f-a7c5-88a4fb3d5043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:01.423422 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83efbe0-ebe5-417f-a7c5-88a4fb3d5043 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:01.423691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83efbe0-ebe5-417f-a7c5-88a4fb3d5043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:01.424003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83efbe0-ebe5-417f-a7c5-88a4fb3d5043 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:01.424746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83efbe0-ebe5-417f-a7c5-88a4fb3d5043 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:01.425211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83efbe0-ebe5-417f-a7c5-88a4fb3d5043 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:01.426847 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83efbe0-ebe5-417f-a7c5-88a4fb3d5043 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:01.444326 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1281/2590] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:01.445192 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d42fb-e7e2-4246-97e8-c7156d88ab67 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:01.467062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d42fb-e7e2-4246-97e8-c7156d88ab67 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:01.473397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5231d-c043-4ca1-ac78-77fa569e4301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:01.474313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5231d-c043-4ca1-ac78-77fa569e4301 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:01.474785 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5231d-c043-4ca1-ac78-77fa569e4301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:01.475223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5231d-c043-4ca1-ac78-77fa569e4301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:01.475952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5231d-c043-4ca1-ac78-77fa569e4301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:01.477888 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5231d-c043-4ca1-ac78-77fa569e4301 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:01.488826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:01.569113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1310/2591] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:01 2022] POST /identity/v3/projects => generated 375 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:01.574358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83efbe0-ebe5-417f-a7c5-88a4fb3d5043 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:01.588216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83efbe0-ebe5-417f-a7c5-88a4fb3d5043 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:01.660710 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a61c0f-9427-4f74-ba73-928b2f53b574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:01.661407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a61c0f-9427-4f74-ba73-928b2f53b574 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:01.661728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a61c0f-9427-4f74-ba73-928b2f53b574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:01.662129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a61c0f-9427-4f74-ba73-928b2f53b574 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:01.663081 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a61c0f-9427-4f74-ba73-928b2f53b574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:01.665185 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a61c0f-9427-4f74-ba73-928b2f53b574 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:01.768103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1282/2592] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:01 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:01.772676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5231d-c043-4ca1-ac78-77fa569e4301 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:01.784762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5231d-c043-4ca1-ac78-77fa569e4301 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:01.789811 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255900f-b004-4a5a-8bd0-13864a63a6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:01.790600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255900f-b004-4a5a-8bd0-13864a63a6e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:01.791359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255900f-b004-4a5a-8bd0-13864a63a6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:01.791359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255900f-b004-4a5a-8bd0-13864a63a6e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:01.792367 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255900f-b004-4a5a-8bd0-13864a63a6e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:01.794394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255900f-b004-4a5a-8bd0-13864a63a6e2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:01.807850 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1311/2593] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:01.811592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a61c0f-9427-4f74-ba73-928b2f53b574 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:01.822872 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a61c0f-9427-4f74-ba73-928b2f53b574 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:01.829449 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c0e48f-3e43-4e0e-9f4c-2174ddf4d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:01.830634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e48f-3e43-4e0e-9f4c-2174ddf4d549 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:01.831093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e48f-3e43-4e0e-9f4c-2174ddf4d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:01.831470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c0e48f-3e43-4e0e-9f4c-2174ddf4d549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:01.832763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0e48f-3e43-4e0e-9f4c-2174ddf4d549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:01.834530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c0e48f-3e43-4e0e-9f4c-2174ddf4d549 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:01.861570 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1283/2594] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:01.863134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255900f-b004-4a5a-8bd0-13864a63a6e2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:01.876407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255900f-b004-4a5a-8bd0-13864a63a6e2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:01.892118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf859c-c8ef-4a16-8d90-d91e7f9842e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:01.893136 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf859c-c8ef-4a16-8d90-d91e7f9842e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:01.893518 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf859c-c8ef-4a16-8d90-d91e7f9842e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:01.893896 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf859c-c8ef-4a16-8d90-d91e7f9842e3 admin admin] PATH_INFO: `/v3/projects/2ed976f527ba4699b88bb7d5d037c734/users/64771b4bc54d486ea65fad8b8e8e9f18/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:01.931328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf859c-c8ef-4a16-8d90-d91e7f9842e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed976f527ba4699b88bb7d5d037c734, user_id=64771b4bc54d486ea65fad8b8e8e9f18, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:01.934436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf859c-c8ef-4a16-8d90-d91e7f9842e3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:02.028781 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1312/2595] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:01 2022] PUT /identity/v3/projects/2ed976f527ba4699b88bb7d5d037c734/users/64771b4bc54d486ea65fad8b8e8e9f18/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:02.038976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7752-9bf7-4d18-9a52-1f29d7521673 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:02.039327 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7752-9bf7-4d18-9a52-1f29d7521673 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:02.039542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559f7752-9bf7-4d18-9a52-1f29d7521673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:02.076875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-559f7752-9bf7-4d18-9a52-1f29d7521673 None None] MFA Rules not processed for user `64771b4bc54d486ea65fad8b8e8e9f18`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:02.078726 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-559f7752-9bf7-4d18-9a52-1f29d7521673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:02.180089 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1284/2596] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:02.195173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf859c-c8ef-4a16-8d90-d91e7f9842e3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:02.197221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6cdf859c-c8ef-4a16-8d90-d91e7f9842e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:02.351478 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf859c-c8ef-4a16-8d90-d91e7f9842e3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:02.363227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f775-cbfa-4948-add1-9afb9b4732b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:02.364393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f775-cbfa-4948-add1-9afb9b4732b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:02.365407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f775-cbfa-4948-add1-9afb9b4732b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:02.365953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044f775-cbfa-4948-add1-9afb9b4732b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:02.377499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044f775-cbfa-4948-add1-9afb9b4732b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:02.379631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2044f775-cbfa-4948-add1-9afb9b4732b1 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:02.396603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1313/2597] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:05.533000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692ad6-593e-4e9e-84df-784c106e4cfc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:05.534250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692ad6-593e-4e9e-84df-784c106e4cfc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:05.534740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11692ad6-593e-4e9e-84df-784c106e4cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:05.567863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-11692ad6-593e-4e9e-84df-784c106e4cfc None None] MFA Rules not processed for user `2d4d46c5076148c7b30364e67c16070d`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:05.569305 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-11692ad6-593e-4e9e-84df-784c106e4cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:05.610497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:05.660818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1285/2598] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:05.665633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f775-cbfa-4948-add1-9afb9b4732b1 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:05.667430 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2044f775-cbfa-4948-add1-9afb9b4732b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:05.757670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2044f775-cbfa-4948-add1-9afb9b4732b1 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:05.763230 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab668b-72d0-4492-82aa-90cbb39ff48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:05.764215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab668b-72d0-4492-82aa-90cbb39ff48c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:05.764814 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab668b-72d0-4492-82aa-90cbb39ff48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:05.765316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab668b-72d0-4492-82aa-90cbb39ff48c admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:05.766104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab668b-72d0-4492-82aa-90cbb39ff48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:05.768115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab668b-72d0-4492-82aa-90cbb39ff48c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:05.893441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1314/2599] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:05 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:05.897271 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692ad6-593e-4e9e-84df-784c106e4cfc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:05.909280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11692ad6-593e-4e9e-84df-784c106e4cfc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:05.983703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1550-ef8e-43a0-b00e-7c956afce269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:05.984487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1550-ef8e-43a0-b00e-7c956afce269 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:05.984771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1550-ef8e-43a0-b00e-7c956afce269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:05.985198 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b1550-ef8e-43a0-b00e-7c956afce269 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:05.985893 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b1550-ef8e-43a0-b00e-7c956afce269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:05.987987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b1550-ef8e-43a0-b00e-7c956afce269 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:06.129376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1286/2600] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:05 2022] POST /identity/v3/users => generated 293 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:06.133421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab668b-72d0-4492-82aa-90cbb39ff48c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:06.144818 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab668b-72d0-4492-82aa-90cbb39ff48c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:06.149630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbd18a-e78f-4208-b515-38e4492fb281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:06.150286 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd18a-e78f-4208-b515-38e4492fb281 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:06.154234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd18a-e78f-4208-b515-38e4492fb281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:06.154234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cbd18a-e78f-4208-b515-38e4492fb281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:06.154234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbd18a-e78f-4208-b515-38e4492fb281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:06.154234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cbd18a-e78f-4208-b515-38e4492fb281 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:06.165922 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1315/2601] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:06.170785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1550-ef8e-43a0-b00e-7c956afce269 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:06.184687 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b1550-ef8e-43a0-b00e-7c956afce269 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:06.187415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ed860-1f2f-4cce-b5e1-459492da980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:06.188382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ed860-1f2f-4cce-b5e1-459492da980d admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:06.188669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ed860-1f2f-4cce-b5e1-459492da980d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:06.188943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ed860-1f2f-4cce-b5e1-459492da980d admin admin] PATH_INFO: `/v3/projects/b5464c5e3fcf4784b3a596da01e630a7/users/1e93266d3d234508984ee176513108b8/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:06.206286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ed860-1f2f-4cce-b5e1-459492da980d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5464c5e3fcf4784b3a596da01e630a7, user_id=1e93266d3d234508984ee176513108b8, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:06.208993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ed860-1f2f-4cce-b5e1-459492da980d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:06.302559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1287/2602] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:06 2022] PUT /identity/v3/projects/b5464c5e3fcf4784b3a596da01e630a7/users/1e93266d3d234508984ee176513108b8/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:06.309856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbd18a-e78f-4208-b515-38e4492fb281 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:06.331996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cbd18a-e78f-4208-b515-38e4492fb281 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:06.369388 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:06.399657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c771c-2401-4ca0-8cd7-fc7f8df9b4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:06.400363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c771c-2401-4ca0-8cd7-fc7f8df9b4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:06.400698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c771c-2401-4ca0-8cd7-fc7f8df9b4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:06.400982 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683c771c-2401-4ca0-8cd7-fc7f8df9b4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:06.401739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c771c-2401-4ca0-8cd7-fc7f8df9b4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:06.404078 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683c771c-2401-4ca0-8cd7-fc7f8df9b4d0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:06.415816 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1316/2603] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:06.421791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ed860-1f2f-4cce-b5e1-459492da980d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:06.435637 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ed860-1f2f-4cce-b5e1-459492da980d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:06.440962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19182214-5028-424a-8188-f804a9e2f968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:06.442029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19182214-5028-424a-8188-f804a9e2f968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:06.443113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19182214-5028-424a-8188-f804a9e2f968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:06.443113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19182214-5028-424a-8188-f804a9e2f968 admin admin] PATH_INFO: `/v3/projects/b5464c5e3fcf4784b3a596da01e630a7/users/1e93266d3d234508984ee176513108b8/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:06.444956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19182214-5028-424a-8188-f804a9e2f968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5464c5e3fcf4784b3a596da01e630a7, user_id=1e93266d3d234508984ee176513108b8, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:06.451034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19182214-5028-424a-8188-f804a9e2f968 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:06.465281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1288/2604] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:06 2022] PUT /identity/v3/projects/b5464c5e3fcf4784b3a596da01e630a7/users/1e93266d3d234508984ee176513108b8/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:10.646420 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c771c-2401-4ca0-8cd7-fc7f8df9b4d0 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:10.650243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-683c771c-2401-4ca0-8cd7-fc7f8df9b4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:10.711648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683c771c-2401-4ca0-8cd7-fc7f8df9b4d0 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:10.770150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e033-3854-4851-bf48-c8df96d92cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:10.770893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e033-3854-4851-bf48-c8df96d92cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:10.771238 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e033-3854-4851-bf48-c8df96d92cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:10.771574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5e033-3854-4851-bf48-c8df96d92cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:10.773681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0fd5e033-3854-4851-bf48-c8df96d92cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:10.871741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5e033-3854-4851-bf48-c8df96d92cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:10.873640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5e033-3854-4851-bf48-c8df96d92cc7 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:10.904809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1317/2605] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:14.397481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d8c5b-e87a-4220-9e36-5639ab14ba23 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:14.400347 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d8c5b-e87a-4220-9e36-5639ab14ba23 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:14.400704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223d8c5b-e87a-4220-9e36-5639ab14ba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:14.436933 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-223d8c5b-e87a-4220-9e36-5639ab14ba23 None None] MFA Rules not processed for user `1e93266d3d234508984ee176513108b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:14.445358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-223d8c5b-e87a-4220-9e36-5639ab14ba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:14.555504 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1289/2606] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:14.571097 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e033-3854-4851-bf48-c8df96d92cc7 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:14.572869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0fd5e033-3854-4851-bf48-c8df96d92cc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:14.646744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:14.686917 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5e033-3854-4851-bf48-c8df96d92cc7 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:14.693984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd8349c-3a0d-4b43-9c9d-bd50d63d55d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:14.694646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8349c-3a0d-4b43-9c9d-bd50d63d55d9 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:14.694925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8349c-3a0d-4b43-9c9d-bd50d63d55d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:14.695203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd8349c-3a0d-4b43-9c9d-bd50d63d55d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:14.756268 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8349c-3a0d-4b43-9c9d-bd50d63d55d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:14.757883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd8349c-3a0d-4b43-9c9d-bd50d63d55d9 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:14.768598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1318/2607] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:15.670695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d8c5b-e87a-4220-9e36-5639ab14ba23 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:15.679022 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:15.685100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223d8c5b-e87a-4220-9e36-5639ab14ba23 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:15.688167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:15.689103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:15.689380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:15.689652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] PATH_INFO: `/v3/users/64771b4bc54d486ea65fad8b8e8e9f18` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:15.690828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] RBAC: Authorizing `identity:delete_user(user_id=64771b4bc54d486ea65fad8b8e8e9f18)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:15.693674 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:15.971765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64771b4bc54d486ea65fad8b8e8e9f18'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:16.001200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64771b4bc54d486ea65fad8b8e8e9f18'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:16.010536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64771b4bc54d486ea65fad8b8e8e9f18'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:16.012154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64771b4bc54d486ea65fad8b8e8e9f18'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:16.012855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64771b4bc54d486ea65fad8b8e8e9f18'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:16.113299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1290/2608] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:15 2022] DELETE /identity/v3/users/64771b4bc54d486ea65fad8b8e8e9f18 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:16.117656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96469-3e18-42ef-95c6-1f0fb7bc809a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:16.118390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96469-3e18-42ef-95c6-1f0fb7bc809a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:16.118390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f96469-3e18-42ef-95c6-1f0fb7bc809a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:16.151712 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-21f96469-3e18-42ef-95c6-1f0fb7bc809a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:16.154072 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-21f96469-3e18-42ef-95c6-1f0fb7bc809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:16.207344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:16.209796 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:16.253582 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1319/2609] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:16.275863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f96469-3e18-42ef-95c6-1f0fb7bc809a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:16.278809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-21f96469-3e18-42ef-95c6-1f0fb7bc809a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:16.342975 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a401c12-89e5-477c-b085-f487566d593c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:16.350648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:16.351839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:16.353412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:16.355336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] PATH_INFO: `/v3/users/111b06722ed54bcaab771e4788015cb4` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:16.357558 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=111b06722ed54bcaab771e4788015cb4)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:16.360152 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:16.423878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f96469-3e18-42ef-95c6-1f0fb7bc809a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:16.434071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665ec52-3d98-46d4-a351-c05d2156b519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:16.434778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665ec52-3d98-46d4-a351-c05d2156b519 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:16.435037 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665ec52-3d98-46d4-a351-c05d2156b519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:16.435313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c665ec52-3d98-46d4-a351-c05d2156b519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:16.455652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665ec52-3d98-46d4-a351-c05d2156b519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:16.457467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c665ec52-3d98-46d4-a351-c05d2156b519 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:16.470631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1320/2610] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:16.742721 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '111b06722ed54bcaab771e4788015cb4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:16.763103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '111b06722ed54bcaab771e4788015cb4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:16.772538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '111b06722ed54bcaab771e4788015cb4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:16.775444 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '111b06722ed54bcaab771e4788015cb4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:16.776214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '111b06722ed54bcaab771e4788015cb4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:16.797705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:16.911277 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1291/2611] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:16 2022] DELETE /identity/v3/users/111b06722ed54bcaab771e4788015cb4 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:17.280088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665ec52-3d98-46d4-a351-c05d2156b519 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:17.282134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c665ec52-3d98-46d4-a351-c05d2156b519 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:17.320668 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c665ec52-3d98-46d4-a351-c05d2156b519 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:17.345745 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:17.400579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:17.402403 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:17.402685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:17.402998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] PATH_INFO: `/v3/projects/2ed976f527ba4699b88bb7d5d037c734` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:17.404288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed976f527ba4699b88bb7d5d037c734)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:17.406224 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:17.513427 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:17.515149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:17.532553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e023ce-107f-4d4c-901c-1e811471ca64 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:17.545423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:17.548316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:17.548793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:17.550929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] PATH_INFO: `/v3/projects/12777fb994a34ea7a3320acd7cd28474` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:17.554816 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12777fb994a34ea7a3320acd7cd28474)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:17.559905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:17.615773 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed976f527ba4699b88bb7d5d037c734', 'request_id': 'req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:17.622061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed976f527ba4699b88bb7d5d037c734', 'request_id': 'req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:17.718375 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed976f527ba4699b88bb7d5d037c734', 'request_id': 'req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:17.741389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] The token cache is being invalidate because project 2ed976f527ba4699b88bb7d5d037c734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:17.741686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:17.747951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-71bbf0fe-c153-494e-a3fe-0bd8fbba29bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:17.749877 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1321/2612] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:17 2022] DELETE /identity/v3/projects/2ed976f527ba4699b88bb7d5d037c734 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:17.760477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf765456-bdef-4f6f-bc7b-ada3a22a974b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:17.760796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf765456-bdef-4f6f-bc7b-ada3a22a974b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:17.761757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf765456-bdef-4f6f-bc7b-ada3a22a974b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:17.782187 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12777fb994a34ea7a3320acd7cd28474', 'request_id': 'req-e709e86c-3a0e-431e-b3f0-8386d249efa2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:17.795278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12777fb994a34ea7a3320acd7cd28474', 'request_id': 'req-e709e86c-3a0e-431e-b3f0-8386d249efa2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:17.804744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-cf765456-bdef-4f6f-bc7b-ada3a22a974b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:17.806017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cf765456-bdef-4f6f-bc7b-ada3a22a974b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:17.903830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12777fb994a34ea7a3320acd7cd28474', 'request_id': 'req-e709e86c-3a0e-431e-b3f0-8386d249efa2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:17.934016 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] The token cache is being invalidate because project 12777fb994a34ea7a3320acd7cd28474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:17.938077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:17.945199 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e709e86c-3a0e-431e-b3f0-8386d249efa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:17.947973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1292/2613] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:17 2022] DELETE /identity/v3/projects/12777fb994a34ea7a3320acd7cd28474 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:17.953513 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe219873-8758-432d-bf2f-44e9a61e8427 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:17.954046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe219873-8758-432d-bf2f-44e9a61e8427 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:17.954483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe219873-8758-432d-bf2f-44e9a61e8427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:17.954856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1322/2614] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:17.972504 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79cb40-1f47-4863-80cd-41ce305c240b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:17.973623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79cb40-1f47-4863-80cd-41ce305c240b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:17.973623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79cb40-1f47-4863-80cd-41ce305c240b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:17.995084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-fb79cb40-1f47-4863-80cd-41ce305c240b None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:17.997228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-fb79cb40-1f47-4863-80cd-41ce305c240b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:18.006962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fe219873-8758-432d-bf2f-44e9a61e8427 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:18.008898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe219873-8758-432d-bf2f-44e9a61e8427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:18.011396 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1323/2615] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:18.012512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79cb40-1f47-4863-80cd-41ce305c240b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.020753 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1293/2616] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:18.029495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb79cb40-1f47-4863-80cd-41ce305c240b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.030060 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0410c5c-a0ca-4585-a1e7-7a695ac0c187 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.030507 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0410c5c-a0ca-4585-a1e7-7a695ac0c187 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.031530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0410c5c-a0ca-4585-a1e7-7a695ac0c187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.034834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cb1d7-dec7-4653-8ae8-1102f4b0b369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.035602 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cb1d7-dec7-4653-8ae8-1102f4b0b369 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.036054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cb1d7-dec7-4653-8ae8-1102f4b0b369 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.036354 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9cb1d7-dec7-4653-8ae8-1102f4b0b369 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.037084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cb1d7-dec7-4653-8ae8-1102f4b0b369 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:18.037401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cb1d7-dec7-4653-8ae8-1102f4b0b369 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.039017 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9cb1d7-dec7-4653-8ae8-1102f4b0b369 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.054126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1324/2617] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:18.056489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a0410c5c-a0ca-4585-a1e7-7a695ac0c187 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:18.058139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a0410c5c-a0ca-4585-a1e7-7a695ac0c187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:18.059445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cb1d7-dec7-4653-8ae8-1102f4b0b369 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.066974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1294/2618] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:18.074723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0410c5c-a0ca-4585-a1e7-7a695ac0c187 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.075788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9cb1d7-dec7-4653-8ae8-1102f4b0b369 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.082435 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412ddd-4ec8-49bc-ac1b-691eb2515a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.083463 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412ddd-4ec8-49bc-ac1b-691eb2515a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.083952 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412ddd-4ec8-49bc-ac1b-691eb2515a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.084641 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60412ddd-4ec8-49bc-ac1b-691eb2515a43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.085632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412ddd-4ec8-49bc-ac1b-691eb2515a43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.087363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60412ddd-4ec8-49bc-ac1b-691eb2515a43 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.095416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0410c5c-a0ca-4585-a1e7-7a695ac0c187 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.095416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5177-5611-4b19-afd9-948445e60a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.095416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5177-5611-4b19-afd9-948445e60a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.095416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5177-5611-4b19-afd9-948445e60a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.095820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5177-5611-4b19-afd9-948445e60a68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.096041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5177-5611-4b19-afd9-948445e60a68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:18.096384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5177-5611-4b19-afd9-948445e60a68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.098038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5177-5611-4b19-afd9-948445e60a68 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.114547 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1295/2619] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:18.115640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5177-5611-4b19-afd9-948445e60a68 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.127602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5177-5611-4b19-afd9-948445e60a68 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.134704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958ad4e-8a64-4dbf-9807-cbf7ca40b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.135488 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958ad4e-8a64-4dbf-9807-cbf7ca40b282 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.136609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958ad4e-8a64-4dbf-9807-cbf7ca40b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.136996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958ad4e-8a64-4dbf-9807-cbf7ca40b282 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.137837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958ad4e-8a64-4dbf-9807-cbf7ca40b282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.140248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958ad4e-8a64-4dbf-9807-cbf7ca40b282 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.263511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1325/2620] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:18 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:18.280106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412ddd-4ec8-49bc-ac1b-691eb2515a43 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.285317 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1296/2621] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:18 2022] POST /identity/v3/projects => generated 371 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:18.289568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958ad4e-8a64-4dbf-9807-cbf7ca40b282 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.335385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:18.410413 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60412ddd-4ec8-49bc-ac1b-691eb2515a43 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.455882 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958ad4e-8a64-4dbf-9807-cbf7ca40b282 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.469995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e929a49-0550-46b0-818b-960b3b762a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.470855 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e929a49-0550-46b0-818b-960b3b762a2c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.471145 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e929a49-0550-46b0-818b-960b3b762a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.471424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e929a49-0550-46b0-818b-960b3b762a2c admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.472174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e929a49-0550-46b0-818b-960b3b762a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.474140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e929a49-0550-46b0-818b-960b3b762a2c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.485172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ea109-c186-4dd5-a0ed-968216ca5e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.486751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ea109-c186-4dd5-a0ed-968216ca5e93 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.486751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ea109-c186-4dd5-a0ed-968216ca5e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.486751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504ea109-c186-4dd5-a0ed-968216ca5e93 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.488001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ea109-c186-4dd5-a0ed-968216ca5e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.490228 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504ea109-c186-4dd5-a0ed-968216ca5e93 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.596276 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1297/2622] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:18 2022] POST /identity/v3/users => generated 286 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:17:18.600761 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e929a49-0550-46b0-818b-960b3b762a2c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.611357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1326/2623] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:18 2022] POST /identity/v3/users => generated 292 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:18.618173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ea109-c186-4dd5-a0ed-968216ca5e93 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.622222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e929a49-0550-46b0-818b-960b3b762a2c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.627758 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a0e8-996e-49bc-936d-1445d3ee3ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.628582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a0e8-996e-49bc-936d-1445d3ee3ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.628934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a0e8-996e-49bc-936d-1445d3ee3ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.629279 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf45a0e8-996e-49bc-936d-1445d3ee3ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.630088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45a0e8-996e-49bc-936d-1445d3ee3ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.631827 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf45a0e8-996e-49bc-936d-1445d3ee3ab8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.650340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504ea109-c186-4dd5-a0ed-968216ca5e93 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.656975 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1298/2624] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:18.658359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a0e8-996e-49bc-936d-1445d3ee3ab8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.664691 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0498e17-ff67-4958-aea6-4e6a7fd9a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.665590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498e17-ff67-4958-aea6-4e6a7fd9a60e admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.665878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498e17-ff67-4958-aea6-4e6a7fd9a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.666549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498e17-ff67-4958-aea6-4e6a7fd9a60e admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.672406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0498e17-ff67-4958-aea6-4e6a7fd9a60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.674826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0498e17-ff67-4958-aea6-4e6a7fd9a60e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.680452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf45a0e8-996e-49bc-936d-1445d3ee3ab8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.686285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1327/2625] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:18.690448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0498e17-ff67-4958-aea6-4e6a7fd9a60e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.693668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7a275-407a-4b41-a5db-da8b303314ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.694362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7a275-407a-4b41-a5db-da8b303314ca admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.694642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7a275-407a-4b41-a5db-da8b303314ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.694916 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d7a275-407a-4b41-a5db-da8b303314ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.695834 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7a275-407a-4b41-a5db-da8b303314ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.697586 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d7a275-407a-4b41-a5db-da8b303314ca admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.714553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1299/2626] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:18.717746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7a275-407a-4b41-a5db-da8b303314ca admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.718626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0498e17-ff67-4958-aea6-4e6a7fd9a60e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.724845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e17776-5688-4d87-b8f2-f709e92de8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.725685 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e17776-5688-4d87-b8f2-f709e92de8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.726216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e17776-5688-4d87-b8f2-f709e92de8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.726630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e17776-5688-4d87-b8f2-f709e92de8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.727660 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e17776-5688-4d87-b8f2-f709e92de8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.730142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d7a275-407a-4b41-a5db-da8b303314ca admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.730348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e17776-5688-4d87-b8f2-f709e92de8b3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.736706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e059b10-2e34-42d7-a920-863c8d419b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.737909 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059b10-2e34-42d7-a920-863c8d419b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.738345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059b10-2e34-42d7-a920-863c8d419b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.750357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059b10-2e34-42d7-a920-863c8d419b72 admin admin] PATH_INFO: `/v3/projects/c63d0d158fb14edc8f41251099eb1c9d/users/9be32c10d97f4611a69936180d87cbb6/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.750626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1328/2627] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:18.751971 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e17776-5688-4d87-b8f2-f709e92de8b3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:18.777083 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e17776-5688-4d87-b8f2-f709e92de8b3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:18.777313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e059b10-2e34-42d7-a920-863c8d419b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63d0d158fb14edc8f41251099eb1c9d, user_id=9be32c10d97f4611a69936180d87cbb6, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.777422 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4343ce-0b8f-4137-be91-74d56f51098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:18.777534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e059b10-2e34-42d7-a920-863c8d419b72 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.777652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4343ce-0b8f-4137-be91-74d56f51098d admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.777652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4343ce-0b8f-4137-be91-74d56f51098d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.777652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4343ce-0b8f-4137-be91-74d56f51098d admin admin] PATH_INFO: `/v3/projects/d172279fa80e49738ced353d676cc750/users/9a34c34832ea44a7bec9ec48eddeebf0/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.793788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4343ce-0b8f-4137-be91-74d56f51098d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d172279fa80e49738ced353d676cc750, user_id=9a34c34832ea44a7bec9ec48eddeebf0, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:18.796688 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4343ce-0b8f-4137-be91-74d56f51098d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:18.902465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1300/2628] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:18 2022] PUT /identity/v3/projects/c63d0d158fb14edc8f41251099eb1c9d/users/9be32c10d97f4611a69936180d87cbb6/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:18.912650 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba7443-817b-4880-9842-e1086a520696 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.912994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba7443-817b-4880-9842-e1086a520696 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.913278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ba7443-817b-4880-9842-e1086a520696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.918492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1329/2629] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:18 2022] PUT /identity/v3/projects/d172279fa80e49738ced353d676cc750/users/9a34c34832ea44a7bec9ec48eddeebf0/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:18.925997 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a425a6a-0de1-415a-85fa-6055f73d0e69 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:18.928511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a425a6a-0de1-415a-85fa-6055f73d0e69 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:18.931153 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a425a6a-0de1-415a-85fa-6055f73d0e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:18.958935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b2ba7443-817b-4880-9842-e1086a520696 None None] MFA Rules not processed for user `9be32c10d97f4611a69936180d87cbb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:18.965930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b2ba7443-817b-4880-9842-e1086a520696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:18.975732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2a425a6a-0de1-415a-85fa-6055f73d0e69 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:18.977187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2a425a6a-0de1-415a-85fa-6055f73d0e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:19.050978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1301/2630] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:19.057003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba7443-817b-4880-9842-e1086a520696 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:19.081550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1330/2631] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:19.094033 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a425a6a-0de1-415a-85fa-6055f73d0e69 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:19.095647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2a425a6a-0de1-415a-85fa-6055f73d0e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:19.146069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ba7443-817b-4880-9842-e1086a520696 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:19.151787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53acacc-5ca0-473a-82b9-f2107547e105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:19.152561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53acacc-5ca0-473a-82b9-f2107547e105 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:19.152941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53acacc-5ca0-473a-82b9-f2107547e105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:19.153567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53acacc-5ca0-473a-82b9-f2107547e105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:19.154541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53acacc-5ca0-473a-82b9-f2107547e105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:19.156859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53acacc-5ca0-473a-82b9-f2107547e105 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:19.159699 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:19.169299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a425a6a-0de1-415a-85fa-6055f73d0e69 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:19.173470 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4442a5-9844-4200-ad4d-d00711ed6c9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:19.174132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4442a5-9844-4200-ad4d-d00711ed6c9b service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:19.174410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4442a5-9844-4200-ad4d-d00711ed6c9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:19.174681 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4442a5-9844-4200-ad4d-d00711ed6c9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:19.185599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4442a5-9844-4200-ad4d-d00711ed6c9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:19.187051 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4442a5-9844-4200-ad4d-d00711ed6c9b service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:19.198042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1331/2632] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:17:19.247967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1302/2633] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:19 2022] POST /identity/v3/projects => generated 371 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:19.250056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4442a5-9844-4200-ad4d-d00711ed6c9b service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:19.260165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4442a5-9844-4200-ad4d-d00711ed6c9b service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:19.331845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d2071-4d06-49f2-af5c-55185338a358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:19.332869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d2071-4d06-49f2-af5c-55185338a358 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:19.332869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d2071-4d06-49f2-af5c-55185338a358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:19.333319 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d2071-4d06-49f2-af5c-55185338a358 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:19.333783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d2071-4d06-49f2-af5c-55185338a358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:19.335739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d2071-4d06-49f2-af5c-55185338a358 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:19.342053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e07db-5b6f-404a-b1d7-8181bb03a7e5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:19.343168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e07db-5b6f-404a-b1d7-8181bb03a7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:19.343323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e07db-5b6f-404a-b1d7-8181bb03a7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:19.382655 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-af1e07db-5b6f-404a-b1d7-8181bb03a7e5 None None] MFA Rules not processed for user `2d4d46c5076148c7b30364e67c16070d`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:19.385320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-af1e07db-5b6f-404a-b1d7-8181bb03a7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:19.451090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1332/2634] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:19 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:19.454898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d2071-4d06-49f2-af5c-55185338a358 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:19.474404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d2071-4d06-49f2-af5c-55185338a358 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:19.489100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d6e1f-f575-452a-998d-0de0fd3597ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:19.491231 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d6e1f-f575-452a-998d-0de0fd3597ec admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:19.492770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d6e1f-f575-452a-998d-0de0fd3597ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:19.493842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4d6e1f-f575-452a-998d-0de0fd3597ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:19.497528 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d6e1f-f575-452a-998d-0de0fd3597ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:19.500316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4d6e1f-f575-452a-998d-0de0fd3597ec admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:19.508647 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1303/2635] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:19.518445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1333/2636] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:19.523130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e07db-5b6f-404a-b1d7-8181bb03a7e5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:19.536166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e07db-5b6f-404a-b1d7-8181bb03a7e5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:19.555771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106434a-e966-4fd5-bd74-28f32e24986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:19.556798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106434a-e966-4fd5-bd74-28f32e24986c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:19.557049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106434a-e966-4fd5-bd74-28f32e24986c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:19.557315 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106434a-e966-4fd5-bd74-28f32e24986c admin admin] PATH_INFO: `/v3/projects/3cfca05e9a124ac2a6f1eeb32976ed5e/users/e6f82e368b5444ae84bbc92431eadfb0/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:19.587562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106434a-e966-4fd5-bd74-28f32e24986c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfca05e9a124ac2a6f1eeb32976ed5e, user_id=e6f82e368b5444ae84bbc92431eadfb0, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:19.600684 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106434a-e966-4fd5-bd74-28f32e24986c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:19.689201 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1304/2637] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:19 2022] PUT /identity/v3/projects/3cfca05e9a124ac2a6f1eeb32976ed5e/users/e6f82e368b5444ae84bbc92431eadfb0/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:19.693188 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d6e1f-f575-452a-998d-0de0fd3597ec admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:19.704541 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4d6e1f-f575-452a-998d-0de0fd3597ec admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:19.768765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc203ce5-a4cb-4f78-b690-eda1fcca0be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:19.769441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc203ce5-a4cb-4f78-b690-eda1fcca0be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:19.769711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc203ce5-a4cb-4f78-b690-eda1fcca0be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:19.770234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc203ce5-a4cb-4f78-b690-eda1fcca0be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:19.770958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc203ce5-a4cb-4f78-b690-eda1fcca0be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:19.773030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc203ce5-a4cb-4f78-b690-eda1fcca0be0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:19.791521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1334/2638] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:19 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:19.797477 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106434a-e966-4fd5-bd74-28f32e24986c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:19.818876 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106434a-e966-4fd5-bd74-28f32e24986c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:19.832707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1a88c-1678-4ee3-92e1-1ba69b37ea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:19.835059 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1a88c-1678-4ee3-92e1-1ba69b37ea48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:19.835819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1a88c-1678-4ee3-92e1-1ba69b37ea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:19.836612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1a88c-1678-4ee3-92e1-1ba69b37ea48 admin admin] PATH_INFO: `/v3/projects/3cfca05e9a124ac2a6f1eeb32976ed5e/users/e6f82e368b5444ae84bbc92431eadfb0/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:19.842962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1a88c-1678-4ee3-92e1-1ba69b37ea48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfca05e9a124ac2a6f1eeb32976ed5e, user_id=e6f82e368b5444ae84bbc92431eadfb0, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:19.849260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1a88c-1678-4ee3-92e1-1ba69b37ea48 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:19.893279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:19.928289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1305/2639] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:19 2022] PUT /identity/v3/projects/3cfca05e9a124ac2a6f1eeb32976ed5e/users/e6f82e368b5444ae84bbc92431eadfb0/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:19.930684 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be93a2c-9739-48ee-a290-6d8aae0948c1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:19.931178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be93a2c-9739-48ee-a290-6d8aae0948c1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:19.931695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be93a2c-9739-48ee-a290-6d8aae0948c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:20.017796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-0be93a2c-9739-48ee-a290-6d8aae0948c1 None None] MFA Rules not processed for user `e6f82e368b5444ae84bbc92431eadfb0`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:20.019468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0be93a2c-9739-48ee-a290-6d8aae0948c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:20.142162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1335/2640] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:19 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:20.155428 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1a88c-1678-4ee3-92e1-1ba69b37ea48 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:20.157233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-05e1a88c-1678-4ee3-92e1-1ba69b37ea48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:20.253020 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1a88c-1678-4ee3-92e1-1ba69b37ea48 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:20.258431 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b91f74-590b-4dcf-a4fe-cc3cfda829a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:20.259579 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91f74-590b-4dcf-a4fe-cc3cfda829a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:20.271194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91f74-590b-4dcf-a4fe-cc3cfda829a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:20.271194 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b91f74-590b-4dcf-a4fe-cc3cfda829a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:20.306776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b91f74-590b-4dcf-a4fe-cc3cfda829a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:20.308990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b91f74-590b-4dcf-a4fe-cc3cfda829a7 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:20.336069 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1306/2641] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:20 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:20.478547 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:20.816195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:21.575839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be93a2c-9739-48ee-a290-6d8aae0948c1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:21.644125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be93a2c-9739-48ee-a290-6d8aae0948c1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:21.648670 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:21.649531 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:21.650949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:21.650949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] PATH_INFO: `/v3/users/9be32c10d97f4611a69936180d87cbb6` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:21.652449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be32c10d97f4611a69936180d87cbb6)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:21.654042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:21.829535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be32c10d97f4611a69936180d87cbb6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:21.966751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be32c10d97f4611a69936180d87cbb6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:21.978114 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be32c10d97f4611a69936180d87cbb6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:21.987704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be32c10d97f4611a69936180d87cbb6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:22.028285 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be32c10d97f4611a69936180d87cbb6'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:22.036802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1336/2642] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:21 2022] DELETE /identity/v3/users/9be32c10d97f4611a69936180d87cbb6 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:22.043269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26524e8d-f571-48a6-b6ff-d4d67404777e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:22.043838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26524e8d-f571-48a6-b6ff-d4d67404777e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:22.044062 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26524e8d-f571-48a6-b6ff-d4d67404777e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:22.078859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-26524e8d-f571-48a6-b6ff-d4d67404777e None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:22.080167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-26524e8d-f571-48a6-b6ff-d4d67404777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:22.205831 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1307/2643] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:22.216163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:22.218984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:22.271874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:22.287495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f039b2c-55c1-4acf-ae6e-a10713185a38 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:22.291155 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a623d0-0330-49fe-838b-ff647677fc14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:22.292663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a623d0-0330-49fe-838b-ff647677fc14 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:22.292948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a623d0-0330-49fe-838b-ff647677fc14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:22.293197 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a623d0-0330-49fe-838b-ff647677fc14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:22.303515 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a623d0-0330-49fe-838b-ff647677fc14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:22.314482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a623d0-0330-49fe-838b-ff647677fc14 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:22.329666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1337/2644] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:22.904003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26524e8d-f571-48a6-b6ff-d4d67404777e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:22.906032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-26524e8d-f571-48a6-b6ff-d4d67404777e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:22.926769 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26524e8d-f571-48a6-b6ff-d4d67404777e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:22.953800 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:22.956113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:22.956381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:22.956754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] PATH_INFO: `/v3/projects/c63d0d158fb14edc8f41251099eb1c9d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:22.958094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63d0d158fb14edc8f41251099eb1c9d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:22.960401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:23.105820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63d0d158fb14edc8f41251099eb1c9d', 'request_id': 'req-add2bbb0-1f27-452e-8289-baacdbea38b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:23.113822 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:23.118247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63d0d158fb14edc8f41251099eb1c9d', 'request_id': 'req-add2bbb0-1f27-452e-8289-baacdbea38b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:23.243363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63d0d158fb14edc8f41251099eb1c9d', 'request_id': 'req-add2bbb0-1f27-452e-8289-baacdbea38b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:23.258819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] The token cache is being invalidate because project c63d0d158fb14edc8f41251099eb1c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:23.262466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:23.262466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:23.265630 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1308/2645] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:22 2022] DELETE /identity/v3/projects/c63d0d158fb14edc8f41251099eb1c9d => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:23.267001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a623d0-0330-49fe-838b-ff647677fc14 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:23.281482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a623d0-0330-49fe-838b-ff647677fc14 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:23.345331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:23.346257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:23.347636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:23.347956 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] PATH_INFO: `/v3/users/e6f82e368b5444ae84bbc92431eadfb0` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:23.349190 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6f82e368b5444ae84bbc92431eadfb0)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:23.351154 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:23.665073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:23.667996 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:23.672004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6f82e368b5444ae84bbc92431eadfb0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:23.734167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add2bbb0-1f27-452e-8289-baacdbea38b6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:23.738033 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3603a-dbad-4d24-939d-06a11dfbd230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:23.738692 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3603a-dbad-4d24-939d-06a11dfbd230 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:23.738973 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3603a-dbad-4d24-939d-06a11dfbd230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:23.739456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3603a-dbad-4d24-939d-06a11dfbd230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:23.741491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dcf3603a-dbad-4d24-939d-06a11dfbd230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:23.757036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3603a-dbad-4d24-939d-06a11dfbd230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:23.758381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3603a-dbad-4d24-939d-06a11dfbd230 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:23.768866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6f82e368b5444ae84bbc92431eadfb0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:23.776487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1309/2646] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:23.780339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6f82e368b5444ae84bbc92431eadfb0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:23.782259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6f82e368b5444ae84bbc92431eadfb0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:23.803566 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-8bdddcb5-ce31-4abe-aa81-a21e2d80338a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6f82e368b5444ae84bbc92431eadfb0'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:23.812381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1338/2647] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:23 2022] DELETE /identity/v3/users/e6f82e368b5444ae84bbc92431eadfb0 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:25.170591 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3603a-dbad-4d24-939d-06a11dfbd230 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:25.172868 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dcf3603a-dbad-4d24-939d-06a11dfbd230 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:25.199711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3603a-dbad-4d24-939d-06a11dfbd230 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:25.309674 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:25.310896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:25.311534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:25.311964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] PATH_INFO: `/v3/projects/3cfca05e9a124ac2a6f1eeb32976ed5e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:25.315102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cfca05e9a124ac2a6f1eeb32976ed5e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:25.317553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:25.480252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cfca05e9a124ac2a6f1eeb32976ed5e', 'request_id': 'req-3d31aa6f-8edb-453c-b900-144e928db645'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:25.498594 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cfca05e9a124ac2a6f1eeb32976ed5e', 'request_id': 'req-3d31aa6f-8edb-453c-b900-144e928db645'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:25.614812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cfca05e9a124ac2a6f1eeb32976ed5e', 'request_id': 'req-3d31aa6f-8edb-453c-b900-144e928db645'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:25.668475 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] The token cache is being invalidate because project 3cfca05e9a124ac2a6f1eeb32976ed5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:25.669164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:25.674100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d31aa6f-8edb-453c-b900-144e928db645 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:25.677929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1310/2648] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:25 2022] DELETE /identity/v3/projects/3cfca05e9a124ac2a6f1eeb32976ed5e => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:25.688151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a1f7-bc9e-45ba-bba8-9ed06b148e72 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:25.688904 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a1f7-bc9e-45ba-bba8-9ed06b148e72 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:25.691486 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518a1f7-bc9e-45ba-bba8-9ed06b148e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:25.729878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5518a1f7-bc9e-45ba-bba8-9ed06b148e72 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:25.732288 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5518a1f7-bc9e-45ba-bba8-9ed06b148e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:25.849620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb0d64-5e82-4cbd-ae47-85e6b273b1ca None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:25.850254 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb0d64-5e82-4cbd-ae47-85e6b273b1ca None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:25.851210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb0d64-5e82-4cbd-ae47-85e6b273b1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:25.862597 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:25.897702 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-12cb0d64-5e82-4cbd-ae47-85e6b273b1ca None None] MFA Rules not processed for user `9a34c34832ea44a7bec9ec48eddeebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:25.899211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-12cb0d64-5e82-4cbd-ae47-85e6b273b1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:25.916211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:25.923987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1339/2649] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:25.931873 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cdb8e-533a-4068-b010-6ff91b71daa4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:25.932325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cdb8e-533a-4068-b010-6ff91b71daa4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:25.932698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5cdb8e-533a-4068-b010-6ff91b71daa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:25.993371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6c5cdb8e-533a-4068-b010-6ff91b71daa4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:25.994969 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6c5cdb8e-533a-4068-b010-6ff91b71daa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:26.018683 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1340/2650] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:26.021137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cdb8e-533a-4068-b010-6ff91b71daa4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:26.022522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6c5cdb8e-533a-4068-b010-6ff91b71daa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:26.023310 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1311/2651] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:26.024424 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb0d64-5e82-4cbd-ae47-85e6b273b1ca None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:26.042458 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5cdb8e-533a-4068-b010-6ff91b71daa4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:26.042992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb0d64-5e82-4cbd-ae47-85e6b273b1ca None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:26.056472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea6f03-d053-4cd5-8ff9-5e1a4138c699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:26.057151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea6f03-d053-4cd5-8ff9-5e1a4138c699 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:26.058143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea6f03-d053-4cd5-8ff9-5e1a4138c699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:26.059937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ea6f03-d053-4cd5-8ff9-5e1a4138c699 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:26.059937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea6f03-d053-4cd5-8ff9-5e1a4138c699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:26.059937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea6f03-d053-4cd5-8ff9-5e1a4138c699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:26.061222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ea6f03-d053-4cd5-8ff9-5e1a4138c699 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:26.061468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a7a4c-243e-4fe5-834a-268ee807a709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:26.062156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7a4c-243e-4fe5-834a-268ee807a709 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:26.062442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7a4c-243e-4fe5-834a-268ee807a709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:26.062740 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a7a4c-243e-4fe5-834a-268ee807a709 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:26.065258 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a7a4c-243e-4fe5-834a-268ee807a709 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:26.067594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a7a4c-243e-4fe5-834a-268ee807a709 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:26.074756 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1312/2652] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:26.080283 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea6f03-d053-4cd5-8ff9-5e1a4138c699 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:26.094514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ea6f03-d053-4cd5-8ff9-5e1a4138c699 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:26.096867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750ad2-4f39-4325-b615-76fd26c284e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:26.097549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750ad2-4f39-4325-b615-76fd26c284e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:26.097833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750ad2-4f39-4325-b615-76fd26c284e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:26.098128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9750ad2-4f39-4325-b615-76fd26c284e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:26.098808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9750ad2-4f39-4325-b615-76fd26c284e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:26.100880 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9750ad2-4f39-4325-b615-76fd26c284e4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:26.188132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1341/2653] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:26 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:17:26.192233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a7a4c-243e-4fe5-834a-268ee807a709 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:26.254815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1313/2654] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:26 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:26.259728 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750ad2-4f39-4325-b615-76fd26c284e4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:26.283874 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a7a4c-243e-4fe5-834a-268ee807a709 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:26.448748 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9750ad2-4f39-4325-b615-76fd26c284e4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:26.451540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785c87a-473d-41ac-b9b3-fb63da10dded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:26.452695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785c87a-473d-41ac-b9b3-fb63da10dded admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:26.454106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785c87a-473d-41ac-b9b3-fb63da10dded admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:26.455148 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9785c87a-473d-41ac-b9b3-fb63da10dded admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:26.456128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd876fe4-7f3c-4dc6-917c-bf39c7618e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:26.456920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd876fe4-7f3c-4dc6-917c-bf39c7618e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:26.459872 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd876fe4-7f3c-4dc6-917c-bf39c7618e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:26.460188 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd876fe4-7f3c-4dc6-917c-bf39c7618e76 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:26.461120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd876fe4-7f3c-4dc6-917c-bf39c7618e76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:26.462315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785c87a-473d-41ac-b9b3-fb63da10dded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:26.463435 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd876fe4-7f3c-4dc6-917c-bf39c7618e76 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:26.469921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9785c87a-473d-41ac-b9b3-fb63da10dded admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:26.623209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1314/2655] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:26 2022] POST /identity/v3/users => generated 285 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:26.628992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd876fe4-7f3c-4dc6-917c-bf39c7618e76 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:26.642489 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd876fe4-7f3c-4dc6-917c-bf39c7618e76 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:26.649124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5eea-1be5-4df9-b67d-23649112f1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:26.650293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5eea-1be5-4df9-b67d-23649112f1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:26.651158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5eea-1be5-4df9-b67d-23649112f1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:26.651595 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f5eea-1be5-4df9-b67d-23649112f1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:26.652907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f5eea-1be5-4df9-b67d-23649112f1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:26.655313 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f5eea-1be5-4df9-b67d-23649112f1f2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:26.657676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1342/2656] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:26 2022] POST /identity/v3/users => generated 299 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:26.662925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785c87a-473d-41ac-b9b3-fb63da10dded admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:26.686721 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9785c87a-473d-41ac-b9b3-fb63da10dded admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:26.691531 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1315/2657] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:26.694963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8bc6f-c848-4281-84dc-92c8f8fc0dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:26.695722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8bc6f-c848-4281-84dc-92c8f8fc0dcd admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:26.698954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8bc6f-c848-4281-84dc-92c8f8fc0dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:26.698954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8bc6f-c848-4281-84dc-92c8f8fc0dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:26.698954 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8bc6f-c848-4281-84dc-92c8f8fc0dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:26.702373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8bc6f-c848-4281-84dc-92c8f8fc0dcd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:26.702517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5eea-1be5-4df9-b67d-23649112f1f2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:26.716999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f5eea-1be5-4df9-b67d-23649112f1f2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:26.724184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb79d0-6b2a-4f30-8060-da852704029b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:26.724564 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb79d0-6b2a-4f30-8060-da852704029b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:26.724883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb79d0-6b2a-4f30-8060-da852704029b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:26.725160 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bb79d0-6b2a-4f30-8060-da852704029b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:26.726511 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb79d0-6b2a-4f30-8060-da852704029b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:26.728441 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bb79d0-6b2a-4f30-8060-da852704029b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:26.732878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1343/2658] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:26.741977 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8bc6f-c848-4281-84dc-92c8f8fc0dcd admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:26.742359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1316/2659] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:26.747798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb79d0-6b2a-4f30-8060-da852704029b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:26.764113 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bb79d0-6b2a-4f30-8060-da852704029b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:26.775634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8bc6f-c848-4281-84dc-92c8f8fc0dcd admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:26.781834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918afd4b-69f2-471d-83e4-17282b65c68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:26.782751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918afd4b-69f2-471d-83e4-17282b65c68f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:26.783035 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918afd4b-69f2-471d-83e4-17282b65c68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:26.783313 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918afd4b-69f2-471d-83e4-17282b65c68f admin admin] PATH_INFO: `/v3/projects/232bda803f124d80a6b1438bc0cbdf52/users/e3003f0bbaa8416bb6e8a1c95d4efde2/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:26.786121 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8817596-eeff-46fb-91ed-e358ea6c88af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:26.787328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8817596-eeff-46fb-91ed-e358ea6c88af admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:26.787718 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8817596-eeff-46fb-91ed-e358ea6c88af admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:26.788540 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8817596-eeff-46fb-91ed-e358ea6c88af admin admin] PATH_INFO: `/v3/projects/bda1eecf23384654bdb891aadee03d64/users/b2f21d49c1214721adc0b47230846e90/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:26.808451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918afd4b-69f2-471d-83e4-17282b65c68f admin admin] RBAC: Authorizing `identity:create_grant(project_id=232bda803f124d80a6b1438bc0cbdf52, user_id=e3003f0bbaa8416bb6e8a1c95d4efde2, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:26.813856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918afd4b-69f2-471d-83e4-17282b65c68f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:26.821567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8817596-eeff-46fb-91ed-e358ea6c88af admin admin] RBAC: Authorizing `identity:create_grant(project_id=bda1eecf23384654bdb891aadee03d64, user_id=b2f21d49c1214721adc0b47230846e90, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:26.824428 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8817596-eeff-46fb-91ed-e358ea6c88af admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:26.965452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1344/2660] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:26 2022] PUT /identity/v3/projects/232bda803f124d80a6b1438bc0cbdf52/users/e3003f0bbaa8416bb6e8a1c95d4efde2/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:26.969690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918afd4b-69f2-471d-83e4-17282b65c68f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:27.025237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1317/2661] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:26 2022] PUT /identity/v3/projects/bda1eecf23384654bdb891aadee03d64/users/b2f21d49c1214721adc0b47230846e90/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:27.037487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5efa51-1507-49b1-bc10-26b0d532ebc2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:27.037908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5efa51-1507-49b1-bc10-26b0d532ebc2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:27.038291 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5efa51-1507-49b1-bc10-26b0d532ebc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:27.074139 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-df5efa51-1507-49b1-bc10-26b0d532ebc2 None None] MFA Rules not processed for user `b2f21d49c1214721adc0b47230846e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:27.075646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918afd4b-69f2-471d-83e4-17282b65c68f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:27.078118 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-df5efa51-1507-49b1-bc10-26b0d532ebc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:27.186413 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0c66d-1c71-4599-90b9-4b20370e8cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:27.190984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0c66d-1c71-4599-90b9-4b20370e8cc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:27.191277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0c66d-1c71-4599-90b9-4b20370e8cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:27.202965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0c66d-1c71-4599-90b9-4b20370e8cc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:27.202965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0c66d-1c71-4599-90b9-4b20370e8cc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:27.202965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede0c66d-1c71-4599-90b9-4b20370e8cc4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:27.211965 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1345/2662] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:27.216553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0c66d-1c71-4599-90b9-4b20370e8cc4 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:27.235373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede0c66d-1c71-4599-90b9-4b20370e8cc4 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:27.241200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1701196-f36d-453b-89a6-a6fa5c4eb11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:27.251022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701196-f36d-453b-89a6-a6fa5c4eb11a admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:27.251022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701196-f36d-453b-89a6-a6fa5c4eb11a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:27.251022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1701196-f36d-453b-89a6-a6fa5c4eb11a admin admin] PATH_INFO: `/v3/projects/232bda803f124d80a6b1438bc0cbdf52/users/e3003f0bbaa8416bb6e8a1c95d4efde2/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:27.251022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1701196-f36d-453b-89a6-a6fa5c4eb11a admin admin] RBAC: Authorizing `identity:create_grant(project_id=232bda803f124d80a6b1438bc0cbdf52, user_id=e3003f0bbaa8416bb6e8a1c95d4efde2, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:27.251378 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1318/2663] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:27.251477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1701196-f36d-453b-89a6-a6fa5c4eb11a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:27.253216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5efa51-1507-49b1-bc10-26b0d532ebc2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:27.267972 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1346/2664] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:27 2022] PUT /identity/v3/projects/232bda803f124d80a6b1438bc0cbdf52/users/e3003f0bbaa8416bb6e8a1c95d4efde2/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:27.269491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5efa51-1507-49b1-bc10-26b0d532ebc2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:27.357686 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993a3bc-ea51-48a5-82bd-d40697436341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:27.358371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993a3bc-ea51-48a5-82bd-d40697436341 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:27.358653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993a3bc-ea51-48a5-82bd-d40697436341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:27.358929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6993a3bc-ea51-48a5-82bd-d40697436341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:27.359701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993a3bc-ea51-48a5-82bd-d40697436341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:27.361670 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6993a3bc-ea51-48a5-82bd-d40697436341 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:27.511514 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1319/2665] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:27 2022] POST /identity/v3/projects => generated 367 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:27.515850 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1701196-f36d-453b-89a6-a6fa5c4eb11a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:27.528295 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1701196-f36d-453b-89a6-a6fa5c4eb11a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:27.596996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b1081-f3c2-4c72-b191-b3b9ad724c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:27.597743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1081-f3c2-4c72-b191-b3b9ad724c74 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:27.598088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1081-f3c2-4c72-b191-b3b9ad724c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:27.598555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1081-f3c2-4c72-b191-b3b9ad724c74 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:27.599345 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b1081-f3c2-4c72-b191-b3b9ad724c74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:27.601439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b1081-f3c2-4c72-b191-b3b9ad724c74 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:27.734989 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1347/2666] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:27 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:17:27.742172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993a3bc-ea51-48a5-82bd-d40697436341 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:27.758299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6993a3bc-ea51-48a5-82bd-d40697436341 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:27.763404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1649513-4153-4def-8cbe-8e2dcec3f083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:27.764100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1649513-4153-4def-8cbe-8e2dcec3f083 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:27.764381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1649513-4153-4def-8cbe-8e2dcec3f083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:27.764652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1649513-4153-4def-8cbe-8e2dcec3f083 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:27.765381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1649513-4153-4def-8cbe-8e2dcec3f083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:27.766992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1649513-4153-4def-8cbe-8e2dcec3f083 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:27.779373 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1320/2667] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:27.786627 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b1081-f3c2-4c72-b191-b3b9ad724c74 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:27.798383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b1081-f3c2-4c72-b191-b3b9ad724c74 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:27.803410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78f041-54d3-4ce2-b0aa-d7daae1bff3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:27.804353 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78f041-54d3-4ce2-b0aa-d7daae1bff3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:27.804635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78f041-54d3-4ce2-b0aa-d7daae1bff3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:27.804903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa78f041-54d3-4ce2-b0aa-d7daae1bff3d admin admin] PATH_INFO: `/v3/projects/6b308b70214446db864358eb8c223f84/users/eea8c02ee0aa4521996f44d1c2433ee3/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:27.825048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78f041-54d3-4ce2-b0aa-d7daae1bff3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b308b70214446db864358eb8c223f84, user_id=eea8c02ee0aa4521996f44d1c2433ee3, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:27.837438 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa78f041-54d3-4ce2-b0aa-d7daae1bff3d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:27.843166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:28.048172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1348/2668] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:27 2022] PUT /identity/v3/projects/6b308b70214446db864358eb8c223f84/users/eea8c02ee0aa4521996f44d1c2433ee3/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:28.052358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1649513-4153-4def-8cbe-8e2dcec3f083 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:28.063213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1649513-4153-4def-8cbe-8e2dcec3f083 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:28.087750 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:28.146563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b60cbba-561e-4c94-978f-2c700f40fff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:28.147293 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60cbba-561e-4c94-978f-2c700f40fff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:28.147582 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60cbba-561e-4c94-978f-2c700f40fff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:28.147956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b60cbba-561e-4c94-978f-2c700f40fff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:28.148631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60cbba-561e-4c94-978f-2c700f40fff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:28.150241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b60cbba-561e-4c94-978f-2c700f40fff1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:28.166372 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1321/2669] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:28.167966 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78f041-54d3-4ce2-b0aa-d7daae1bff3d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:28.180801 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa78f041-54d3-4ce2-b0aa-d7daae1bff3d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:28.192951 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d50a5-2e05-4a1c-b412-207b20f55992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:28.193935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d50a5-2e05-4a1c-b412-207b20f55992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:28.194219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d50a5-2e05-4a1c-b412-207b20f55992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:28.194501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d50a5-2e05-4a1c-b412-207b20f55992 admin admin] PATH_INFO: `/v3/projects/6b308b70214446db864358eb8c223f84/users/eea8c02ee0aa4521996f44d1c2433ee3/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:28.197323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d50a5-2e05-4a1c-b412-207b20f55992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b308b70214446db864358eb8c223f84, user_id=eea8c02ee0aa4521996f44d1c2433ee3, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:28.201871 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d50a5-2e05-4a1c-b412-207b20f55992 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:28.219476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1349/2670] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:28 2022] PUT /identity/v3/projects/6b308b70214446db864358eb8c223f84/users/eea8c02ee0aa4521996f44d1c2433ee3/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:28.235058 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb10f3-c9ab-4972-b11d-479b6f0bcdd2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:28.235554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb10f3-c9ab-4972-b11d-479b6f0bcdd2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:28.235877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb10f3-c9ab-4972-b11d-479b6f0bcdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:28.265818 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-56bb10f3-c9ab-4972-b11d-479b6f0bcdd2 None None] MFA Rules not processed for user `eea8c02ee0aa4521996f44d1c2433ee3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:28.267331 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-56bb10f3-c9ab-4972-b11d-479b6f0bcdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:28.406382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1322/2671] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:28 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:28.418280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d50a5-2e05-4a1c-b412-207b20f55992 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:28.420265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-549d50a5-2e05-4a1c-b412-207b20f55992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:28.529036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d50a5-2e05-4a1c-b412-207b20f55992 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:28.532973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e8331-3881-4e20-afc8-2c4ca48aa0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:28.533732 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e8331-3881-4e20-afc8-2c4ca48aa0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:28.534108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e8331-3881-4e20-afc8-2c4ca48aa0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:28.534501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e8331-3881-4e20-afc8-2c4ca48aa0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:28.563014 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e8331-3881-4e20-afc8-2c4ca48aa0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:28.564680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e8331-3881-4e20-afc8-2c4ca48aa0b8 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:28.576974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1350/2672] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:28 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:17:29.175730 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:29.398075 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb10f3-c9ab-4972-b11d-479b6f0bcdd2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:29.399681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-56bb10f3-c9ab-4972-b11d-479b6f0bcdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:29.410619 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:29.501266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb10f3-c9ab-4972-b11d-479b6f0bcdd2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:29.509068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d211f1-1f74-4b86-8146-6b355201074f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e52a3464d8f4a3fa16a102336a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:29.510098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d211f1-1f74-4b86-8146-6b355201074f service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:29.510807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d211f1-1f74-4b86-8146-6b355201074f service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:29.511391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d211f1-1f74-4b86-8146-6b355201074f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:29.514312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-37d211f1-1f74-4b86-8146-6b355201074f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:29.532356 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d211f1-1f74-4b86-8146-6b355201074f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:29.534899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d211f1-1f74-4b86-8146-6b355201074f service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:29.557612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1323/2673] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:17:29.596842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e8331-3881-4e20-afc8-2c4ca48aa0b8 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:29.596842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-3e8e8331-3881-4e20-afc8-2c4ca48aa0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:29.704423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e8331-3881-4e20-afc8-2c4ca48aa0b8 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:29.710471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:29.712178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:29.712643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:29.713112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] PATH_INFO: `/v3/users/8cbac3c664d944788b05516600b7df25` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:29.716643 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cbac3c664d944788b05516600b7df25)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:29.723223 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:30.052617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cbac3c664d944788b05516600b7df25'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:30.148984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cbac3c664d944788b05516600b7df25'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:30.174518 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cbac3c664d944788b05516600b7df25'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:30.175783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cbac3c664d944788b05516600b7df25'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:30.204609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-e7af48ca-7769-4e7f-8c87-2fc601e6258c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cbac3c664d944788b05516600b7df25'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:30.211762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1351/2674] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:29 2022] DELETE /identity/v3/users/8cbac3c664d944788b05516600b7df25 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:30.679312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d211f1-1f74-4b86-8146-6b355201074f service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:30.694402 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d211f1-1f74-4b86-8146-6b355201074f service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:30.777553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:30.777553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:30.777553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:30.777553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] PATH_INFO: `/v3/projects/c19ac26c5a284c4c84f3f9f3003a7e7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:30.777971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c19ac26c5a284c4c84f3f9f3003a7e7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:30.778942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:30.975804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c19ac26c5a284c4c84f3f9f3003a7e7c', 'request_id': 'req-351d9dea-cf86-4208-93c5-07149c1bb7f4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:30.989366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c19ac26c5a284c4c84f3f9f3003a7e7c', 'request_id': 'req-351d9dea-cf86-4208-93c5-07149c1bb7f4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:31.165971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c19ac26c5a284c4c84f3f9f3003a7e7c', 'request_id': 'req-351d9dea-cf86-4208-93c5-07149c1bb7f4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:31.184862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] The token cache is being invalidate because project c19ac26c5a284c4c84f3f9f3003a7e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:31.185270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:31.186798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-351d9dea-cf86-4208-93c5-07149c1bb7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:31.191680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1324/2675] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:30 2022] DELETE /identity/v3/projects/c19ac26c5a284c4c84f3f9f3003a7e7c => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:31.196384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559810b-ed30-44d3-b59e-64b23229caad None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:31.196859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559810b-ed30-44d3-b59e-64b23229caad None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:31.197131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559810b-ed30-44d3-b59e-64b23229caad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:31.223363 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a559810b-ed30-44d3-b59e-64b23229caad None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:31.224798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a559810b-ed30-44d3-b59e-64b23229caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:31.274820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:31.329141 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:31.374585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1352/2676] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:31.387478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba58d-d282-4733-8e96-100a7ad36d97 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:31.392145 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba58d-d282-4733-8e96-100a7ad36d97 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:31.392561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba58d-d282-4733-8e96-100a7ad36d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:31.422232 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cedba58d-d282-4733-8e96-100a7ad36d97 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:31.424154 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cedba58d-d282-4733-8e96-100a7ad36d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:31.436346 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1325/2677] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:31.439270 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559810b-ed30-44d3-b59e-64b23229caad None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:31.452252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559810b-ed30-44d3-b59e-64b23229caad None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:31.467535 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33032ad-a6b3-4689-a535-6e45042cbe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:31.468394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33032ad-a6b3-4689-a535-6e45042cbe30 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:31.468775 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33032ad-a6b3-4689-a535-6e45042cbe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:31.469148 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33032ad-a6b3-4689-a535-6e45042cbe30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:31.469986 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33032ad-a6b3-4689-a535-6e45042cbe30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:31.470392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33032ad-a6b3-4689-a535-6e45042cbe30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:31.472331 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33032ad-a6b3-4689-a535-6e45042cbe30 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:31.508771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba58d-d282-4733-8e96-100a7ad36d97 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:31.521021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1353/2678] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:31.523842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba58d-d282-4733-8e96-100a7ad36d97 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:31.536482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f8ed0-ee15-4f75-83d6-0f90bc1a741f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:31.537217 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f8ed0-ee15-4f75-83d6-0f90bc1a741f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:31.537682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f8ed0-ee15-4f75-83d6-0f90bc1a741f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:31.537977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f8ed0-ee15-4f75-83d6-0f90bc1a741f admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:31.542917 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f8ed0-ee15-4f75-83d6-0f90bc1a741f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:31.545128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f8ed0-ee15-4f75-83d6-0f90bc1a741f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:31.658821 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1326/2679] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:31 2022] POST /identity/v3/projects => generated 405 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:31.663394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33032ad-a6b3-4689-a535-6e45042cbe30 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:31.675619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33032ad-a6b3-4689-a535-6e45042cbe30 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:31.797845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8fc9f-2a47-4c95-842c-60c33f3e5f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:31.798677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8fc9f-2a47-4c95-842c-60c33f3e5f68 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:31.799021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8fc9f-2a47-4c95-842c-60c33f3e5f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:31.799519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f8fc9f-2a47-4c95-842c-60c33f3e5f68 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:31.800379 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8fc9f-2a47-4c95-842c-60c33f3e5f68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:31.802275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f8fc9f-2a47-4c95-842c-60c33f3e5f68 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:32.030769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1354/2680] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:31 2022] POST /identity/v3/users => generated 303 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:17:32.035104 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f8ed0-ee15-4f75-83d6-0f90bc1a741f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:32.050826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f8ed0-ee15-4f75-83d6-0f90bc1a741f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:32.066982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6617b9-cdc0-4062-bce1-2e3f69c79662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:32.067815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6617b9-cdc0-4062-bce1-2e3f69c79662 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:32.068230 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6617b9-cdc0-4062-bce1-2e3f69c79662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:32.069612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6617b9-cdc0-4062-bce1-2e3f69c79662 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:32.076302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6617b9-cdc0-4062-bce1-2e3f69c79662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:32.078457 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6617b9-cdc0-4062-bce1-2e3f69c79662 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:32.096580 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1327/2681] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:32.097895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8fc9f-2a47-4c95-842c-60c33f3e5f68 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:32.109676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f8fc9f-2a47-4c95-842c-60c33f3e5f68 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:32.131185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c91bdd-e858-45f4-ac80-4661f807ff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:32.132172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c91bdd-e858-45f4-ac80-4661f807ff5a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:32.134336 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c91bdd-e858-45f4-ac80-4661f807ff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:32.137391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c91bdd-e858-45f4-ac80-4661f807ff5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:32.138425 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c91bdd-e858-45f4-ac80-4661f807ff5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:32.147029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c91bdd-e858-45f4-ac80-4661f807ff5a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:32.184412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1355/2682] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:32.188787 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6617b9-cdc0-4062-bce1-2e3f69c79662 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:32.204905 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6617b9-cdc0-4062-bce1-2e3f69c79662 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:32.222669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4da3d-aa98-4b80-864c-ed12ff112c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:32.223913 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4da3d-aa98-4b80-864c-ed12ff112c4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:32.228942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4da3d-aa98-4b80-864c-ed12ff112c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:32.228942 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4da3d-aa98-4b80-864c-ed12ff112c4c admin admin] PATH_INFO: `/v3/projects/d548113135204af4891a9ddf7404041b/users/c46ac2e340ee47f4b784c957b3e3b3f8/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:32.274096 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4da3d-aa98-4b80-864c-ed12ff112c4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d548113135204af4891a9ddf7404041b, user_id=c46ac2e340ee47f4b784c957b3e3b3f8, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:32.276936 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4da3d-aa98-4b80-864c-ed12ff112c4c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:32.399243 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1328/2683] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:32 2022] PUT /identity/v3/projects/d548113135204af4891a9ddf7404041b/users/c46ac2e340ee47f4b784c957b3e3b3f8/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:32.416201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe04f2-cf6e-469c-894d-8c4e681d4b1b None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:32.417315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe04f2-cf6e-469c-894d-8c4e681d4b1b None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:32.417315 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe04f2-cf6e-469c-894d-8c4e681d4b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:32.475985 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-53fe04f2-cf6e-469c-894d-8c4e681d4b1b None None] MFA Rules not processed for user `c46ac2e340ee47f4b784c957b3e3b3f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:32.477690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-53fe04f2-cf6e-469c-894d-8c4e681d4b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:32.642365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1356/2684] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:32.647816 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4da3d-aa98-4b80-864c-ed12ff112c4c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:32.730483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4da3d-aa98-4b80-864c-ed12ff112c4c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:32.735654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49bda-50e0-4819-a7b1-fa7ebfed3e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:32.736572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49bda-50e0-4819-a7b1-fa7ebfed3e8b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:32.737247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49bda-50e0-4819-a7b1-fa7ebfed3e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:32.737685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a49bda-50e0-4819-a7b1-fa7ebfed3e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:32.738569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a49bda-50e0-4819-a7b1-fa7ebfed3e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:32.740860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a49bda-50e0-4819-a7b1-fa7ebfed3e8b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:32.880495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1329/2685] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:32 2022] POST /identity/v3/projects => generated 403 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:32.884903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe04f2-cf6e-469c-894d-8c4e681d4b1b None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:32.899332 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe04f2-cf6e-469c-894d-8c4e681d4b1b None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:33.034128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49d4f-d827-4217-b091-0b789e3fcdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:33.035220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49d4f-d827-4217-b091-0b789e3fcdf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:33.036516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49d4f-d827-4217-b091-0b789e3fcdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:33.036856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d49d4f-d827-4217-b091-0b789e3fcdf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:33.038103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49d4f-d827-4217-b091-0b789e3fcdf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:33.042297 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d49d4f-d827-4217-b091-0b789e3fcdf6 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:33.202023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49bda-50e0-4819-a7b1-fa7ebfed3e8b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:33.203798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-59a49bda-50e0-4819-a7b1-fa7ebfed3e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:33.218588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1357/2686] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:32 2022] POST /identity/v3/users => generated 308 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:33.219211 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a49bda-50e0-4819-a7b1-fa7ebfed3e8b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:33.222311 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49d4f-d827-4217-b091-0b789e3fcdf6 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:33.230963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:33.231888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:33.232363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:33.232852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] PATH_INFO: `/v3/users/b2f21d49c1214721adc0b47230846e90` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:33.235371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f21d49c1214721adc0b47230846e90)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:33.239337 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:33.243371 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d49d4f-d827-4217-b091-0b789e3fcdf6 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:33.254870 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109f207-1f10-4388-b1ac-a6cffa04a719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:33.255799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109f207-1f10-4388-b1ac-a6cffa04a719 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:33.257942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109f207-1f10-4388-b1ac-a6cffa04a719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:33.258523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9109f207-1f10-4388-b1ac-a6cffa04a719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:33.259046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109f207-1f10-4388-b1ac-a6cffa04a719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:33.264723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9109f207-1f10-4388-b1ac-a6cffa04a719 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:33.296302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1358/2687] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:33.297275 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109f207-1f10-4388-b1ac-a6cffa04a719 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:33.319556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9109f207-1f10-4388-b1ac-a6cffa04a719 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:33.325550 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c017834-8df0-4861-a3dd-2ef2863bde4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:33.326512 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017834-8df0-4861-a3dd-2ef2863bde4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:33.326722 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017834-8df0-4861-a3dd-2ef2863bde4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:33.327195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c017834-8df0-4861-a3dd-2ef2863bde4f admin admin] PATH_INFO: `/v3/projects/5b32938b92b345d5b1b38688fe1cf491/users/5dc45a300aa449d08cf04d347612551c/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:33.345580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c017834-8df0-4861-a3dd-2ef2863bde4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b32938b92b345d5b1b38688fe1cf491, user_id=5dc45a300aa449d08cf04d347612551c, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:33.348779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c017834-8df0-4861-a3dd-2ef2863bde4f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:33.495383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1359/2688] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:33 2022] PUT /identity/v3/projects/5b32938b92b345d5b1b38688fe1cf491/users/5dc45a300aa449d08cf04d347612551c/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:33.499941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c017834-8df0-4861-a3dd-2ef2863bde4f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:33.536562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:33.549102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f21d49c1214721adc0b47230846e90'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:33.572311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f21d49c1214721adc0b47230846e90'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:33.575893 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c017834-8df0-4861-a3dd-2ef2863bde4f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:33.583639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bc88d-f20b-4429-b2f3-45032df65b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:33.585981 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f21d49c1214721adc0b47230846e90'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:33.586170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bc88d-f20b-4429-b2f3-45032df65b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:33.586784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bc88d-f20b-4429-b2f3-45032df65b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:33.587262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bc88d-f20b-4429-b2f3-45032df65b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:33.587899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f21d49c1214721adc0b47230846e90'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:33.589041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bc88d-f20b-4429-b2f3-45032df65b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:33.589361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd11f357-56b2-4bbf-b31c-215384a3dfef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f21d49c1214721adc0b47230846e90'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:33.590676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bc88d-f20b-4429-b2f3-45032df65b54 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:33.635329 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1360/2689] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:33.638289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bc88d-f20b-4429-b2f3-45032df65b54 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:33.642647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6b7bc88d-f20b-4429-b2f3-45032df65b54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:33.663404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bc88d-f20b-4429-b2f3-45032df65b54 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:33.673996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f920c33-a275-4448-9e0a-fd37ea3386d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:33.674575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f920c33-a275-4448-9e0a-fd37ea3386d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:33.674851 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f920c33-a275-4448-9e0a-fd37ea3386d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:33.675348 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f920c33-a275-4448-9e0a-fd37ea3386d2 admin admin] PATH_INFO: `/v3/projects/5b32938b92b345d5b1b38688fe1cf491/users/5dc45a300aa449d08cf04d347612551c/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:33.678259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f920c33-a275-4448-9e0a-fd37ea3386d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b32938b92b345d5b1b38688fe1cf491, user_id=5dc45a300aa449d08cf04d347612551c, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:33.682665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f920c33-a275-4448-9e0a-fd37ea3386d2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:33.707884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1361/2690] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:33 2022] PUT /identity/v3/projects/5b32938b92b345d5b1b38688fe1cf491/users/5dc45a300aa449d08cf04d347612551c/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:33.713128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a4893-be88-4c2e-90b5-4410e744673f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:33.713128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a4893-be88-4c2e-90b5-4410e744673f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:33.713128 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a4893-be88-4c2e-90b5-4410e744673f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:33.766608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1330/2691] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:33 2022] DELETE /identity/v3/users/b2f21d49c1214721adc0b47230846e90 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:33.771658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1809be-5970-4d30-be6b-5cc36eb55701 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:33.772166 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1809be-5970-4d30-be6b-5cc36eb55701 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:33.773716 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-2a2a4893-be88-4c2e-90b5-4410e744673f None None] MFA Rules not processed for user `5dc45a300aa449d08cf04d347612551c`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:33.773949 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1809be-5970-4d30-be6b-5cc36eb55701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:33.774973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2a2a4893-be88-4c2e-90b5-4410e744673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:33.847620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5f1809be-5970-4d30-be6b-5cc36eb55701 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:33.849369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5f1809be-5970-4d30-be6b-5cc36eb55701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:33.955678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1362/2692] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:33 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:33.971456 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a4893-be88-4c2e-90b5-4410e744673f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:33.972981 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-2a2a4893-be88-4c2e-90b5-4410e744673f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:34.006176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1331/2693] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:34.029652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1809be-5970-4d30-be6b-5cc36eb55701 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:34.031794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5f1809be-5970-4d30-be6b-5cc36eb55701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:34.086686 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a4893-be88-4c2e-90b5-4410e744673f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:34.091538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aeabe-05c6-467e-8892-bb1506e1582f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:34.092293 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aeabe-05c6-467e-8892-bb1506e1582f service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:34.092585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aeabe-05c6-467e-8892-bb1506e1582f service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:34.093015 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0aeabe-05c6-467e-8892-bb1506e1582f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:34.104617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0aeabe-05c6-467e-8892-bb1506e1582f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:34.106585 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0aeabe-05c6-467e-8892-bb1506e1582f service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:34.117704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1809be-5970-4d30-be6b-5cc36eb55701 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:34.126657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008265a1-b8c4-4b8c-95ce-29de42f99e45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:34.127497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008265a1-b8c4-4b8c-95ce-29de42f99e45 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:34.127789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008265a1-b8c4-4b8c-95ce-29de42f99e45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:34.128102 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008265a1-b8c4-4b8c-95ce-29de42f99e45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:34.128805 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1363/2694] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:33 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:17:34.139903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008265a1-b8c4-4b8c-95ce-29de42f99e45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:34.142266 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008265a1-b8c4-4b8c-95ce-29de42f99e45 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:34.174379 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1332/2695] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:34.295343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aeabe-05c6-467e-8892-bb1506e1582f service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:34.316454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0aeabe-05c6-467e-8892-bb1506e1582f service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:34.321247 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:34.322493 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:34.322798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:34.323103 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] PATH_INFO: `/v3/users/c46ac2e340ee47f4b784c957b3e3b3f8` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:34.324474 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46ac2e340ee47f4b784c957b3e3b3f8)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:34.326613 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:34.575955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:34.608577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46ac2e340ee47f4b784c957b3e3b3f8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:34.704629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46ac2e340ee47f4b784c957b3e3b3f8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:34.717900 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46ac2e340ee47f4b784c957b3e3b3f8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:34.718895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46ac2e340ee47f4b784c957b3e3b3f8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:34.733671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46ac2e340ee47f4b784c957b3e3b3f8'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:34.742604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1364/2696] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:34 2022] DELETE /identity/v3/users/c46ac2e340ee47f4b784c957b3e3b3f8 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:34.748666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535752fd-cfee-469c-a381-cf32c88d30a8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:34.749235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535752fd-cfee-469c-a381-cf32c88d30a8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:34.749235 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535752fd-cfee-469c-a381-cf32c88d30a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:34.782609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-535752fd-cfee-469c-a381-cf32c88d30a8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:34.782609 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-535752fd-cfee-469c-a381-cf32c88d30a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:34.869136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1333/2697] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:34.880990 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:34.883671 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:34.934998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535752fd-cfee-469c-a381-cf32c88d30a8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:34.940148 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-535752fd-cfee-469c-a381-cf32c88d30a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:34.960496 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535752fd-cfee-469c-a381-cf32c88d30a8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:34.972385 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:34.973491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:34.973940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:34.974381 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] PATH_INFO: `/v3/projects/bda1eecf23384654bdb891aadee03d64` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:34.976024 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bda1eecf23384654bdb891aadee03d64)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:34.981071 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:34.998992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2a5bc-1172-433c-8fa3-1184aa90dd89 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:35.016071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ad5fe-2002-4051-9ce4-572502a63f15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:35.019553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad5fe-2002-4051-9ce4-572502a63f15 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:35.030248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad5fe-2002-4051-9ce4-572502a63f15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:35.030248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ad5fe-2002-4051-9ce4-572502a63f15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:35.034880 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ad5fe-2002-4051-9ce4-572502a63f15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:35.037374 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9ad5fe-2002-4051-9ce4-572502a63f15 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:35.054810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1365/2698] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:35.177536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bda1eecf23384654bdb891aadee03d64', 'request_id': 'req-f225b8ec-0168-4968-80e6-16e866d4d227'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.194099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bda1eecf23384654bdb891aadee03d64', 'request_id': 'req-f225b8ec-0168-4968-80e6-16e866d4d227'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.265789 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7289a5-6d1f-48b6-9979-926dc8421ec8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:35.266373 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7289a5-6d1f-48b6-9979-926dc8421ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:35.266817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7289a5-6d1f-48b6-9979-926dc8421ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:35.304967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-7a7289a5-6d1f-48b6-9979-926dc8421ec8 None None] MFA Rules not processed for user `e3003f0bbaa8416bb6e8a1c95d4efde2`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:35.306212 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7a7289a5-6d1f-48b6-9979-926dc8421ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:35.312941 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bda1eecf23384654bdb891aadee03d64', 'request_id': 'req-f225b8ec-0168-4968-80e6-16e866d4d227'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.338908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] The token cache is being invalidate because project bda1eecf23384654bdb891aadee03d64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:35.339559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.340011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.341647 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1334/2699] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:34 2022] DELETE /identity/v3/projects/bda1eecf23384654bdb891aadee03d64 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:35.349396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:35.353010 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:35.425124 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1366/2700] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:35 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:17:35.450910 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7289a5-6d1f-48b6-9979-926dc8421ec8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:35.451448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225b8ec-0168-4968-80e6-16e866d4d227 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:35.454583 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-7a7289a5-6d1f-48b6-9979-926dc8421ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:35.458606 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:35.460448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:35.463115 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:35.464412 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] PATH_INFO: `/v3/users/eea8c02ee0aa4521996f44d1c2433ee3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:35.467234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eea8c02ee0aa4521996f44d1c2433ee3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:35.473994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:35.540593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7289a5-6d1f-48b6-9979-926dc8421ec8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:35.544841 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dff8b7-1055-4823-8cd3-4f0a743976f0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2169b05e64224f69bcc1d9ce912a60e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:35.545494 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dff8b7-1055-4823-8cd3-4f0a743976f0 service glance] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:35.545772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dff8b7-1055-4823-8cd3-4f0a743976f0 service glance] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:35.546045 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dff8b7-1055-4823-8cd3-4f0a743976f0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:35.547980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d2dff8b7-1055-4823-8cd3-4f0a743976f0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:35.623006 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dff8b7-1055-4823-8cd3-4f0a743976f0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:35.628733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dff8b7-1055-4823-8cd3-4f0a743976f0 service glance] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:35.641689 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1367/2701] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:35.673651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dff8b7-1055-4823-8cd3-4f0a743976f0 service glance] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:35.675606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d2dff8b7-1055-4823-8cd3-4f0a743976f0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:35.697122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dff8b7-1055-4823-8cd3-4f0a743976f0 service glance] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:35.705626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:35.706743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:35.707241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:35.707522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] PATH_INFO: `/v3/projects/d548113135204af4891a9ddf7404041b` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:35.708861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d548113135204af4891a9ddf7404041b)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:35.710800 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:35.771642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eea8c02ee0aa4521996f44d1c2433ee3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.785437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eea8c02ee0aa4521996f44d1c2433ee3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.793401 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eea8c02ee0aa4521996f44d1c2433ee3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.795653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eea8c02ee0aa4521996f44d1c2433ee3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.795653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ad3440cd-b8e7-407c-b7d8-706ddddd75c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eea8c02ee0aa4521996f44d1c2433ee3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.867169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd548113135204af4891a9ddf7404041b', 'request_id': 'req-b8800b60-3066-4664-b074-bd3dfa79240c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.874240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd548113135204af4891a9ddf7404041b', 'request_id': 'req-b8800b60-3066-4664-b074-bd3dfa79240c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:35.902384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1335/2702] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:35 2022] DELETE /identity/v3/users/eea8c02ee0aa4521996f44d1c2433ee3 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:35.926907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e995bc-e150-4306-b1c7-0e88705445f6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:35.927197 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e995bc-e150-4306-b1c7-0e88705445f6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:35.927473 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e995bc-e150-4306-b1c7-0e88705445f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:35.952459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b6e995bc-e150-4306-b1c7-0e88705445f6 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:35.953931 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b6e995bc-e150-4306-b1c7-0e88705445f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:36.020115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd548113135204af4891a9ddf7404041b', 'request_id': 'req-b8800b60-3066-4664-b074-bd3dfa79240c'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.028842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1336/2703] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:17:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:17:36.038967 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] The token cache is being invalidate because project d548113135204af4891a9ddf7404041b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:36.039328 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.040119 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.042661 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1368/2704] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:35 2022] DELETE /identity/v3/projects/d548113135204af4891a9ddf7404041b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:36.046759 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e995bc-e150-4306-b1c7-0e88705445f6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:36.048404 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b6e995bc-e150-4306-b1c7-0e88705445f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:36.052289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:36.053809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:36.121737 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e995bc-e150-4306-b1c7-0e88705445f6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:36.129038 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8800b60-3066-4664-b074-bd3dfa79240c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:36.130553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:36.131522 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:36.131865 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:36.132241 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] PATH_INFO: `/v3/users/5dc45a300aa449d08cf04d347612551c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:36.133533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dc45a300aa449d08cf04d347612551c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:36.135901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:36.200184 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e57dc-6eb9-4782-ab84-3542774ed81b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:36.200924 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e57dc-6eb9-4782-ab84-3542774ed81b service swift] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:36.201205 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e57dc-6eb9-4782-ab84-3542774ed81b service swift] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:36.201477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e57dc-6eb9-4782-ab84-3542774ed81b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:36.203368 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-200e57dc-6eb9-4782-ab84-3542774ed81b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:36.219019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e57dc-6eb9-4782-ab84-3542774ed81b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:36.220623 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e57dc-6eb9-4782-ab84-3542774ed81b service swift] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:36.230455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1369/2705] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 22:17:36.365227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dc45a300aa449d08cf04d347612551c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.380639 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dc45a300aa449d08cf04d347612551c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.390670 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dc45a300aa449d08cf04d347612551c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.391539 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dc45a300aa449d08cf04d347612551c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.392222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-62bf404b-5c18-4b47-af0b-9e7aea62268d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dc45a300aa449d08cf04d347612551c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.467747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e57dc-6eb9-4782-ab84-3542774ed81b service swift] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:36.469839 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-200e57dc-6eb9-4782-ab84-3542774ed81b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:36.490564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e57dc-6eb9-4782-ab84-3542774ed81b service swift] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:36.516596 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:36.518831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:36.519140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:36.519455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] PATH_INFO: `/v3/projects/6b308b70214446db864358eb8c223f84` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:36.520994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b308b70214446db864358eb8c223f84)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:36.522978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:36.530002 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1337/2706] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:36 2022] DELETE /identity/v3/users/5dc45a300aa449d08cf04d347612551c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:36.696169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b308b70214446db864358eb8c223f84', 'request_id': 'req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.705399 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b308b70214446db864358eb8c223f84', 'request_id': 'req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.778663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b308b70214446db864358eb8c223f84', 'request_id': 'req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.798750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] The token cache is being invalidate because project 6b308b70214446db864358eb8c223f84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:36.799581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.800791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-bd00ca7f-eeb1-4821-a6d4-6f151e135ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:36.808442 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ff32-d67a-4283-aeff-5f5a4c52b6f5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:36.808945 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ff32-d67a-4283-aeff-5f5a4c52b6f5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:36.809339 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9ff32-d67a-4283-aeff-5f5a4c52b6f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:36.822571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1370/2707] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:36 2022] DELETE /identity/v3/projects/6b308b70214446db864358eb8c223f84 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:36.858384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-19d9ff32-d67a-4283-aeff-5f5a4c52b6f5 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:36.859655 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-19d9ff32-d67a-4283-aeff-5f5a4c52b6f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:36.974527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1338/2708] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:17:36.983148 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005593-b3a2-4e93-b3c8-74e61f65ace1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:36.984003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005593-b3a2-4e93-b3c8-74e61f65ace1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:36.984704 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27005593-b3a2-4e93-b3c8-74e61f65ace1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.012427 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-27005593-b3a2-4e93-b3c8-74e61f65ace1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:37.017365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-27005593-b3a2-4e93-b3c8-74e61f65ace1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:37.030798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1371/2709] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:37.035777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9ff32-d67a-4283-aeff-5f5a4c52b6f5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:37.062306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9ff32-d67a-4283-aeff-5f5a4c52b6f5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:37.068032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870376e5-674e-48b0-ba51-d53ba2b6be35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:37.068809 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870376e5-674e-48b0-ba51-d53ba2b6be35 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.069289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870376e5-674e-48b0-ba51-d53ba2b6be35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.069747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870376e5-674e-48b0-ba51-d53ba2b6be35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.070734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870376e5-674e-48b0-ba51-d53ba2b6be35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:37.071231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870376e5-674e-48b0-ba51-d53ba2b6be35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:37.073538 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870376e5-674e-48b0-ba51-d53ba2b6be35 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:37.095559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1339/2710] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:37.099640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005593-b3a2-4e93-b3c8-74e61f65ace1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:37.120263 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27005593-b3a2-4e93-b3c8-74e61f65ace1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:37.127895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092311b-e12b-433f-b633-a45721af9aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:37.132062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092311b-e12b-433f-b633-a45721af9aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.132062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092311b-e12b-433f-b633-a45721af9aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.132062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a092311b-e12b-433f-b633-a45721af9aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.132062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092311b-e12b-433f-b633-a45721af9aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:37.132764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a092311b-e12b-433f-b633-a45721af9aa1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:37.182739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870376e5-674e-48b0-ba51-d53ba2b6be35 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:37.182739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-870376e5-674e-48b0-ba51-d53ba2b6be35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:37.208829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:37.209657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870376e5-674e-48b0-ba51-d53ba2b6be35 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:37.235049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:37.237088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.237379 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.237660 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] PATH_INFO: `/v3/projects/5b32938b92b345d5b1b38688fe1cf491` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.241943 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b32938b92b345d5b1b38688fe1cf491)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:37.248018 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:37.289169 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1372/2711] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:37 2022] POST /identity/v3/projects => generated 367 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:37.296126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092311b-e12b-433f-b633-a45721af9aa1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:37.410590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a092311b-e12b-433f-b633-a45721af9aa1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:37.421414 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b32938b92b345d5b1b38688fe1cf491', 'request_id': 'req-81493da2-36ea-4566-bed2-b41be46f87c0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:37.433549 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b32938b92b345d5b1b38688fe1cf491', 'request_id': 'req-81493da2-36ea-4566-bed2-b41be46f87c0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:37.521082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cdb5d-72d8-4bc4-ba9e-4c83ee44dcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:37.522215 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdb5d-72d8-4bc4-ba9e-4c83ee44dcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.522680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdb5d-72d8-4bc4-ba9e-4c83ee44dcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.525548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cdb5d-72d8-4bc4-ba9e-4c83ee44dcb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.527545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cdb5d-72d8-4bc4-ba9e-4c83ee44dcb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:37.528846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b32938b92b345d5b1b38688fe1cf491', 'request_id': 'req-81493da2-36ea-4566-bed2-b41be46f87c0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:37.530811 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cdb5d-72d8-4bc4-ba9e-4c83ee44dcb1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:37.548529 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:37.565262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] The token cache is being invalidate because project 5b32938b92b345d5b1b38688fe1cf491 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:37.565696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:37.567860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81493da2-36ea-4566-bed2-b41be46f87c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:37.569460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1340/2712] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:37 2022] DELETE /identity/v3/projects/5b32938b92b345d5b1b38688fe1cf491 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:37.576730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b36e-8bed-4b96-93b5-79c57b1f4ce7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.579960 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b36e-8bed-4b96-93b5-79c57b1f4ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.580344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b36e-8bed-4b96-93b5-79c57b1f4ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.625437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e337b36e-8bed-4b96-93b5-79c57b1f4ce7 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:37.627627 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e337b36e-8bed-4b96-93b5-79c57b1f4ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:37.640064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1341/2713] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:17:37.648569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e091d-7c2d-40d2-861f-971a5e4bebb6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.649098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e091d-7c2d-40d2-861f-971a5e4bebb6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.649590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436e091d-7c2d-40d2-861f-971a5e4bebb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.658178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1373/2714] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:37 2022] POST /identity/v3/users => generated 284 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:37.660570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cdb5d-72d8-4bc4-ba9e-4c83ee44dcb1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:37.663107 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5d8cdb5d-72d8-4bc4-ba9e-4c83ee44dcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:37.683825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-436e091d-7c2d-40d2-861f-971a5e4bebb6 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:37.684949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cdb5d-72d8-4bc4-ba9e-4c83ee44dcb1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:37.688357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-436e091d-7c2d-40d2-861f-971a5e4bebb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:37.694002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42f289-b741-4d6c-94be-63e80a406aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:37.694810 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42f289-b741-4d6c-94be-63e80a406aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.695197 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42f289-b741-4d6c-94be-63e80a406aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.695580 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42f289-b741-4d6c-94be-63e80a406aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.696787 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42f289-b741-4d6c-94be-63e80a406aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:37.699102 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42f289-b741-4d6c-94be-63e80a406aa5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:37.707390 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1342/2715] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:37.715068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e091d-7c2d-40d2-861f-971a5e4bebb6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:37.715894 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1374/2716] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:37.721846 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42f289-b741-4d6c-94be-63e80a406aa5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:37.739172 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42f289-b741-4d6c-94be-63e80a406aa5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:37.745937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436e091d-7c2d-40d2-861f-971a5e4bebb6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:37.747498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32addc-dd69-46a6-943e-a66ff915ba91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:37.748269 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32addc-dd69-46a6-943e-a66ff915ba91 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.748674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32addc-dd69-46a6-943e-a66ff915ba91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.749050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32addc-dd69-46a6-943e-a66ff915ba91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.749978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32addc-dd69-46a6-943e-a66ff915ba91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:37.751906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32addc-dd69-46a6-943e-a66ff915ba91 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:37.763290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a0aec-50f8-41c6-bd0a-b7408a39cc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:37.764029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a0aec-50f8-41c6-bd0a-b7408a39cc52 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.764311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a0aec-50f8-41c6-bd0a-b7408a39cc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.764640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a0aec-50f8-41c6-bd0a-b7408a39cc52 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.765380 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a0aec-50f8-41c6-bd0a-b7408a39cc52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:37.765735 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a0aec-50f8-41c6-bd0a-b7408a39cc52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:37.774671 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a0aec-50f8-41c6-bd0a-b7408a39cc52 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:37.793118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1375/2717] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:37 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:37.798088 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32addc-dd69-46a6-943e-a66ff915ba91 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:37.818723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32addc-dd69-46a6-943e-a66ff915ba91 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:37.826190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1343/2718] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:37.828895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637af0e-a05e-424a-8576-5bfbcbd2c6c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:37.829383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a0aec-50f8-41c6-bd0a-b7408a39cc52 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:37.830015 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637af0e-a05e-424a-8576-5bfbcbd2c6c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.830391 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637af0e-a05e-424a-8576-5bfbcbd2c6c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.830791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637af0e-a05e-424a-8576-5bfbcbd2c6c1 admin admin] PATH_INFO: `/v3/projects/86c663bd943b423da99448a31d60f516/users/3739928f43be4c20b131ed39101d49f9/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.855742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a0aec-50f8-41c6-bd0a-b7408a39cc52 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:37.859909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637af0e-a05e-424a-8576-5bfbcbd2c6c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c663bd943b423da99448a31d60f516, user_id=3739928f43be4c20b131ed39101d49f9, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:37.864885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637af0e-a05e-424a-8576-5bfbcbd2c6c1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:37.870849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef061042-f007-4712-8ab6-9ae6d3a562cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:37.870849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef061042-f007-4712-8ab6-9ae6d3a562cf admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:37.870849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef061042-f007-4712-8ab6-9ae6d3a562cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:37.870849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef061042-f007-4712-8ab6-9ae6d3a562cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:37.871284 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef061042-f007-4712-8ab6-9ae6d3a562cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:37.875190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef061042-f007-4712-8ab6-9ae6d3a562cf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:38.036022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1376/2719] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:37 2022] PUT /identity/v3/projects/86c663bd943b423da99448a31d60f516/users/3739928f43be4c20b131ed39101d49f9/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:38.042364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2e416-f40e-4bfb-b31e-2529c845fe21 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:38.042364 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2e416-f40e-4bfb-b31e-2529c845fe21 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:38.042645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2e416-f40e-4bfb-b31e-2529c845fe21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:38.081757 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d6f2e416-f40e-4bfb-b31e-2529c845fe21 None None] MFA Rules not processed for user `3739928f43be4c20b131ed39101d49f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:38.083013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d6f2e416-f40e-4bfb-b31e-2529c845fe21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:38.106107 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1344/2720] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:37 2022] POST /identity/v3/projects => generated 379 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:38.107744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef061042-f007-4712-8ab6-9ae6d3a562cf admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:38.196789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef061042-f007-4712-8ab6-9ae6d3a562cf admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:38.204240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bfed7-c115-4dae-adf3-5617136a26db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:38.205229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bfed7-c115-4dae-adf3-5617136a26db admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:38.205738 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bfed7-c115-4dae-adf3-5617136a26db admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:38.206205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29bfed7-c115-4dae-adf3-5617136a26db admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:38.207056 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bfed7-c115-4dae-adf3-5617136a26db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:38.209228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29bfed7-c115-4dae-adf3-5617136a26db admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:38.234977 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1377/2721] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:38.239417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2e416-f40e-4bfb-b31e-2529c845fe21 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:38.320001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1345/2722] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:38 2022] POST /identity/v3/users => generated 290 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:38.324448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bfed7-c115-4dae-adf3-5617136a26db admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:38.335559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2e416-f40e-4bfb-b31e-2529c845fe21 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:38.341852 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce589c-210f-45b3-ba70-5b1eb83a62c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:38.342885 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce589c-210f-45b3-ba70-5b1eb83a62c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:38.343499 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce589c-210f-45b3-ba70-5b1eb83a62c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:38.343942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce589c-210f-45b3-ba70-5b1eb83a62c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:38.344673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29bfed7-c115-4dae-adf3-5617136a26db admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:38.345170 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce589c-210f-45b3-ba70-5b1eb83a62c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:38.348096 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce589c-210f-45b3-ba70-5b1eb83a62c9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:38.351220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d87f3-e421-44d5-a04b-859c318bfb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:38.352085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d87f3-e421-44d5-a04b-859c318bfb57 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:38.353567 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d87f3-e421-44d5-a04b-859c318bfb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:38.355993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432d87f3-e421-44d5-a04b-859c318bfb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:38.356954 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d87f3-e421-44d5-a04b-859c318bfb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:38.359306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432d87f3-e421-44d5-a04b-859c318bfb57 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:38.377366 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1346/2723] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:38.381255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d87f3-e421-44d5-a04b-859c318bfb57 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:38.393559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432d87f3-e421-44d5-a04b-859c318bfb57 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:38.401101 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcd23-e85a-46ec-9155-f0bc4cc7f9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:38.402063 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcd23-e85a-46ec-9155-f0bc4cc7f9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:38.402520 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcd23-e85a-46ec-9155-f0bc4cc7f9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:38.403050 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fcd23-e85a-46ec-9155-f0bc4cc7f9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:38.404029 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fcd23-e85a-46ec-9155-f0bc4cc7f9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:38.405819 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4fcd23-e85a-46ec-9155-f0bc4cc7f9c8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:38.423460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1347/2724] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:38.425311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcd23-e85a-46ec-9155-f0bc4cc7f9c8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:38.438363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fcd23-e85a-46ec-9155-f0bc4cc7f9c8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:38.444320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf22dd-de20-41c7-b96e-79cc08c36245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:38.445153 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf22dd-de20-41c7-b96e-79cc08c36245 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:38.445436 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf22dd-de20-41c7-b96e-79cc08c36245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:38.445713 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf22dd-de20-41c7-b96e-79cc08c36245 admin admin] PATH_INFO: `/v3/projects/3e3320b37f08472aa0822ff2d35a6eb8/users/0ff360006b4244caa08d385dfd840227/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:38.466497 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf22dd-de20-41c7-b96e-79cc08c36245 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e3320b37f08472aa0822ff2d35a6eb8, user_id=0ff360006b4244caa08d385dfd840227, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:38.469592 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf22dd-de20-41c7-b96e-79cc08c36245 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:38.498025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1378/2725] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:38 2022] POST /identity/v3/projects => generated 369 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:38.499736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce589c-210f-45b3-ba70-5b1eb83a62c9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:38.586536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1348/2726] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:38 2022] PUT /identity/v3/projects/3e3320b37f08472aa0822ff2d35a6eb8/users/0ff360006b4244caa08d385dfd840227/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:38.604224 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd525c6-15c6-4638-99ca-8434583adf9a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:38.610899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd525c6-15c6-4638-99ca-8434583adf9a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:38.611413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd525c6-15c6-4638-99ca-8434583adf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:38.664238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2dd525c6-15c6-4638-99ca-8434583adf9a None None] MFA Rules not processed for user `0ff360006b4244caa08d385dfd840227`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:38.670995 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2dd525c6-15c6-4638-99ca-8434583adf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:38.696024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce589c-210f-45b3-ba70-5b1eb83a62c9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:38.817223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1349/2727] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:38.823483 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd525c6-15c6-4638-99ca-8434583adf9a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:38.834451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea5e6f-04b2-46ae-8cb5-065214724695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:38.839532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea5e6f-04b2-46ae-8cb5-065214724695 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:38.839532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea5e6f-04b2-46ae-8cb5-065214724695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:38.839532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea5e6f-04b2-46ae-8cb5-065214724695 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:38.839532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea5e6f-04b2-46ae-8cb5-065214724695 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:38.839532 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea5e6f-04b2-46ae-8cb5-065214724695 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:38.914238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd525c6-15c6-4638-99ca-8434583adf9a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:38.920482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef7ba5-0d25-43ca-9b80-73849e300771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:38.922007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef7ba5-0d25-43ca-9b80-73849e300771 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:38.941036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef7ba5-0d25-43ca-9b80-73849e300771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:38.941036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef7ba5-0d25-43ca-9b80-73849e300771 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:38.941036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef7ba5-0d25-43ca-9b80-73849e300771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:38.941036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef7ba5-0d25-43ca-9b80-73849e300771 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:38.943652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1379/2728] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:38 2022] POST /identity/v3/users => generated 291 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:38.953141 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea5e6f-04b2-46ae-8cb5-065214724695 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:38.977610 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea5e6f-04b2-46ae-8cb5-065214724695 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:38.997709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da154f4-6d60-4655-a793-da09e795d0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:38.998827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da154f4-6d60-4655-a793-da09e795d0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:38.999409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da154f4-6d60-4655-a793-da09e795d0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:39.000217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da154f4-6d60-4655-a793-da09e795d0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:39.001844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da154f4-6d60-4655-a793-da09e795d0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:39.004794 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da154f4-6d60-4655-a793-da09e795d0f2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:39.021569 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1380/2729] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:39.026162 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da154f4-6d60-4655-a793-da09e795d0f2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:39.063399 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da154f4-6d60-4655-a793-da09e795d0f2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:39.075692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f2f85-6e1d-427c-81b0-509987fd0c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:39.079254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f2f85-6e1d-427c-81b0-509987fd0c8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:39.079667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f2f85-6e1d-427c-81b0-509987fd0c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:39.080237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f2f85-6e1d-427c-81b0-509987fd0c8e admin admin] PATH_INFO: `/v3/projects/5f9ac3d03ac04df4b156fd45993282d6/users/7d5a28e4dacf43b4979c61b93f93a5aa/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:39.089286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1350/2730] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:38 2022] POST /identity/v3/projects => generated 379 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:39.093384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef7ba5-0d25-43ca-9b80-73849e300771 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:39.134588 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f2f85-6e1d-427c-81b0-509987fd0c8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9ac3d03ac04df4b156fd45993282d6, user_id=7d5a28e4dacf43b4979c61b93f93a5aa, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:39.143025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f2f85-6e1d-427c-81b0-509987fd0c8e admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:39.259150 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1381/2731] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:39 2022] PUT /identity/v3/projects/5f9ac3d03ac04df4b156fd45993282d6/users/7d5a28e4dacf43b4979c61b93f93a5aa/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:39.264595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:39.268106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f2f85-6e1d-427c-81b0-509987fd0c8e admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:39.301596 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef7ba5-0d25-43ca-9b80-73849e300771 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:39.403365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f8f6-7277-487a-b6bf-fe7e65403e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:39.404550 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f8f6-7277-487a-b6bf-fe7e65403e6d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:39.405096 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f8f6-7277-487a-b6bf-fe7e65403e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:39.405669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f03f8f6-7277-487a-b6bf-fe7e65403e6d admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:39.406708 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03f8f6-7277-487a-b6bf-fe7e65403e6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:39.409091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f03f8f6-7277-487a-b6bf-fe7e65403e6d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:39.420410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f2f85-6e1d-427c-81b0-509987fd0c8e admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:39.440326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec48a7-1cc6-49a4-8612-a386aa9aed68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:39.441477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec48a7-1cc6-49a4-8612-a386aa9aed68 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:39.441983 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec48a7-1cc6-49a4-8612-a386aa9aed68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:39.442473 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec48a7-1cc6-49a4-8612-a386aa9aed68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:39.443481 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec48a7-1cc6-49a4-8612-a386aa9aed68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:39.445445 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec48a7-1cc6-49a4-8612-a386aa9aed68 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:39.476464 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1382/2732] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:39.477709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec48a7-1cc6-49a4-8612-a386aa9aed68 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:39.499193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1351/2733] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:39 2022] POST /identity/v3/users => generated 296 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:39.505149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f8f6-7277-487a-b6bf-fe7e65403e6d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:39.516820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec48a7-1cc6-49a4-8612-a386aa9aed68 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:39.522936 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c80d612-b68c-49f4-bd8e-dcc854ca52a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:39.526598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80d612-b68c-49f4-bd8e-dcc854ca52a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:39.526598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80d612-b68c-49f4-bd8e-dcc854ca52a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:39.526598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c80d612-b68c-49f4-bd8e-dcc854ca52a0 admin admin] PATH_INFO: `/v3/projects/5f9ac3d03ac04df4b156fd45993282d6/users/7d5a28e4dacf43b4979c61b93f93a5aa/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:39.526910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f03f8f6-7277-487a-b6bf-fe7e65403e6d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:39.528180 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80d612-b68c-49f4-bd8e-dcc854ca52a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9ac3d03ac04df4b156fd45993282d6, user_id=7d5a28e4dacf43b4979c61b93f93a5aa, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:39.531398 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549664e4-b052-4d9c-9c8f-0d7c0844c5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:39.531837 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c80d612-b68c-49f4-bd8e-dcc854ca52a0 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:39.532307 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549664e4-b052-4d9c-9c8f-0d7c0844c5aa admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:39.532743 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549664e4-b052-4d9c-9c8f-0d7c0844c5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:39.533126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549664e4-b052-4d9c-9c8f-0d7c0844c5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:39.534039 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549664e4-b052-4d9c-9c8f-0d7c0844c5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:39.537299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549664e4-b052-4d9c-9c8f-0d7c0844c5aa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:39.565677 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1383/2734] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:39 2022] PUT /identity/v3/projects/5f9ac3d03ac04df4b156fd45993282d6/users/7d5a28e4dacf43b4979c61b93f93a5aa/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:39.567780 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1352/2735] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:39.568801 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549664e4-b052-4d9c-9c8f-0d7c0844c5aa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:39.576903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bc5b9-79e2-4b71-a557-937d3ed2f40c None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:39.577259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bc5b9-79e2-4b71-a557-937d3ed2f40c None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:39.577545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bc5b9-79e2-4b71-a557-937d3ed2f40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:39.585802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549664e4-b052-4d9c-9c8f-0d7c0844c5aa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:39.644084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-a04bc5b9-79e2-4b71-a557-937d3ed2f40c None None] MFA Rules not processed for user `7d5a28e4dacf43b4979c61b93f93a5aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:39.647271 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a04bc5b9-79e2-4b71-a557-937d3ed2f40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:39.678642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883aac15-c9b6-463e-9b5e-2dc6484ca533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:39.679607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aac15-c9b6-463e-9b5e-2dc6484ca533 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:39.679901 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aac15-c9b6-463e-9b5e-2dc6484ca533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:39.680228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883aac15-c9b6-463e-9b5e-2dc6484ca533 admin admin] PATH_INFO: `/v3/projects/a185539696904abbbc7c52437c42ccb5/users/f9c0c7f5d461496f925ee9015550c484/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:39.703231 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883aac15-c9b6-463e-9b5e-2dc6484ca533 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a185539696904abbbc7c52437c42ccb5, user_id=f9c0c7f5d461496f925ee9015550c484, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:39.705950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883aac15-c9b6-463e-9b5e-2dc6484ca533 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:39.759780 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1384/2736] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:39.768820 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bc5b9-79e2-4b71-a557-937d3ed2f40c None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:39.772415 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a04bc5b9-79e2-4b71-a557-937d3ed2f40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:39.838944 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1353/2737] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:39 2022] PUT /identity/v3/projects/a185539696904abbbc7c52437c42ccb5/users/f9c0c7f5d461496f925ee9015550c484/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:39.842679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883aac15-c9b6-463e-9b5e-2dc6484ca533 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:39.888326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bc5b9-79e2-4b71-a557-937d3ed2f40c None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:40.006378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc9680-9f1a-4d18-8395-a78530803dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:40.007439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc9680-9f1a-4d18-8395-a78530803dee service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:40.008029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc9680-9f1a-4d18-8395-a78530803dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:40.008536 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc9680-9f1a-4d18-8395-a78530803dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:40.022281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883aac15-c9b6-463e-9b5e-2dc6484ca533 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:40.028332 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161cf69-932e-4cfd-b4e2-2c8510a2db9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:40.029089 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161cf69-932e-4cfd-b4e2-2c8510a2db9e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:40.029382 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161cf69-932e-4cfd-b4e2-2c8510a2db9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:40.029711 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161cf69-932e-4cfd-b4e2-2c8510a2db9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:40.035053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161cf69-932e-4cfd-b4e2-2c8510a2db9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:40.035053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161cf69-932e-4cfd-b4e2-2c8510a2db9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:40.049405 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1354/2738] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:40.053453 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161cf69-932e-4cfd-b4e2-2c8510a2db9e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:40.067140 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161cf69-932e-4cfd-b4e2-2c8510a2db9e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:40.074239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505c30ee-f9d3-4607-b5f7-36c2ae9ab50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:40.075886 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c30ee-f9d3-4607-b5f7-36c2ae9ab50a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:40.076463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c30ee-f9d3-4607-b5f7-36c2ae9ab50a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:40.076838 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505c30ee-f9d3-4607-b5f7-36c2ae9ab50a admin admin] PATH_INFO: `/v3/projects/a185539696904abbbc7c52437c42ccb5/users/f9c0c7f5d461496f925ee9015550c484/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:40.079156 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c30ee-f9d3-4607-b5f7-36c2ae9ab50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a185539696904abbbc7c52437c42ccb5, user_id=f9c0c7f5d461496f925ee9015550c484, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:40.082681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505c30ee-f9d3-4607-b5f7-36c2ae9ab50a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:40.108498 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1355/2739] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:40 2022] PUT /identity/v3/projects/a185539696904abbbc7c52437c42ccb5/users/f9c0c7f5d461496f925ee9015550c484/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:40.118500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338144-dd67-471e-a249-0b95480d7848 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:40.118965 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338144-dd67-471e-a249-0b95480d7848 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:40.119387 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5338144-dd67-471e-a249-0b95480d7848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:40.163428 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc9680-9f1a-4d18-8395-a78530803dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:40.164991 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc9680-9f1a-4d18-8395-a78530803dee service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:40.177982 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:40.188156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1385/2740] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:17:40.244280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d5338144-dd67-471e-a249-0b95480d7848 None None] MFA Rules not processed for user `f9c0c7f5d461496f925ee9015550c484`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:40.244280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d5338144-dd67-471e-a249-0b95480d7848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:40.382976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc9680-9f1a-4d18-8395-a78530803dee service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:40.385555 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1afc9680-9f1a-4d18-8395-a78530803dee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:40.426105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc9680-9f1a-4d18-8395-a78530803dee service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:40.502361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1356/2741] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:40 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:17:40.518269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5338144-dd67-471e-a249-0b95480d7848 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:40.575522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccef01-8bb0-4585-baa4-29ace8c69909 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:40.576401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccef01-8bb0-4585-baa4-29ace8c69909 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:40.576695 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccef01-8bb0-4585-baa4-29ace8c69909 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:40.580591 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccef01-8bb0-4585-baa4-29ace8c69909 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:40.715479 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccef01-8bb0-4585-baa4-29ace8c69909 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:40.717023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccef01-8bb0-4585-baa4-29ace8c69909 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:40.721887 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5338144-dd67-471e-a249-0b95480d7848 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:40.741614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbd887-dc51-4968-a093-19ea1ff10008 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:40.741614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbd887-dc51-4968-a093-19ea1ff10008 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:40.741614 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbd887-dc51-4968-a093-19ea1ff10008 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:40.745206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1386/2742] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:40 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:40.745377 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbd887-dc51-4968-a093-19ea1ff10008 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:40.765673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbd887-dc51-4968-a093-19ea1ff10008 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:40.767680 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdbd887-dc51-4968-a093-19ea1ff10008 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:40.780426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1357/2743] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:40 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:41.422612 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:42.403004 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccef01-8bb0-4585-baa4-29ace8c69909 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:42.428630 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccef01-8bb0-4585-baa4-29ace8c69909 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:42.436472 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d0d5d-4a74-440d-88dd-eda4d8564bd3 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9c0c7f5d461496f925ee9015550c484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a185539696904abbbc7c52437c42ccb5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:42.438171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d0d5d-4a74-440d-88dd-eda4d8564bd3 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:42.438914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d0d5d-4a74-440d-88dd-eda4d8564bd3 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:42.439419 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d0d5d-4a74-440d-88dd-eda4d8564bd3 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:42.440687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d0d5d-4a74-440d-88dd-eda4d8564bd3 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:42.441224 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d0d5d-4a74-440d-88dd-eda4d8564bd3 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:42.443456 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d0d5d-4a74-440d-88dd-eda4d8564bd3 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:42.462807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1387/2744] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:17:42.467370 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbd887-dc51-4968-a093-19ea1ff10008 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:42.488936 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbd887-dc51-4968-a093-19ea1ff10008 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:42.500511 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9e525-b008-4ff3-aecd-cc3a442d086c tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9c0c7f5d461496f925ee9015550c484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a185539696904abbbc7c52437c42ccb5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:42.501407 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9e525-b008-4ff3-aecd-cc3a442d086c tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:42.501695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9e525-b008-4ff3-aecd-cc3a442d086c tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:42.501978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9e525-b008-4ff3-aecd-cc3a442d086c tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:42.502689 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9e525-b008-4ff3-aecd-cc3a442d086c tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:42.505338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9e525-b008-4ff3-aecd-cc3a442d086c tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:42.540528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:42.597210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1358/2745] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:42 2022] POST /identity/v3/projects => generated 355 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:42.599116 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d0d5d-4a74-440d-88dd-eda4d8564bd3 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:42.618517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d0d5d-4a74-440d-88dd-eda4d8564bd3 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:42.739651 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cf681-43f2-46c9-80e2-061c07638de7 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9c0c7f5d461496f925ee9015550c484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a185539696904abbbc7c52437c42ccb5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:42.740484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cf681-43f2-46c9-80e2-061c07638de7 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:42.740863 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cf681-43f2-46c9-80e2-061c07638de7 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:42.741378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061cf681-43f2-46c9-80e2-061c07638de7 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:42.742222 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cf681-43f2-46c9-80e2-061c07638de7 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:42.742631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cf681-43f2-46c9-80e2-061c07638de7 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:42.745432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061cf681-43f2-46c9-80e2-061c07638de7 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:42.767346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1388/2746] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:42.813399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9e525-b008-4ff3-aecd-cc3a442d086c tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:42.820441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:42.830034 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9e525-b008-4ff3-aecd-cc3a442d086c tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:42.844658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f9c0c7f5d461496f925ee9015550c484', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a185539696904abbbc7c52437c42ccb5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:42.845553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:42.845841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:42.846120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] PATH_INFO: `/v3/projects/ac9dcbc340f0417097231fd639efe9cf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:42.847799 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ac9dcbc340f0417097231fd639efe9cf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:42.849793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:42.992298 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac9dcbc340f0417097231fd639efe9cf', 'request_id': 'req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:43.009421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac9dcbc340f0417097231fd639efe9cf', 'request_id': 'req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:43.116962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac9dcbc340f0417097231fd639efe9cf', 'request_id': 'req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:43.134551 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] The token cache is being invalidate because project ac9dcbc340f0417097231fd639efe9cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:43.136642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:43.138275 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a51d6a11-a54f-44ca-8114-3c6ca0d89a08 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:43.141813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1359/2747] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:42 2022] DELETE /identity/v3/projects/ac9dcbc340f0417097231fd639efe9cf => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:43.868574 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:44.049579 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cf681-43f2-46c9-80e2-061c07638de7 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:44.052544 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-061cf681-43f2-46c9-80e2-061c07638de7 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:44.136577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061cf681-43f2-46c9-80e2-061c07638de7 tempest-VolumeQuotaClassesTest-207145650 tempest-VolumeQuotaClassesTest-207145650-project-admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:44.204151 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:44.205441 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:44.205934 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:44.206414 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] PATH_INFO: `/v3/users/0ff360006b4244caa08d385dfd840227` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:44.208156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff360006b4244caa08d385dfd840227)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:44.210233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:44.269969 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:44.441571 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff360006b4244caa08d385dfd840227'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:44.531253 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff360006b4244caa08d385dfd840227'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:44.543607 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff360006b4244caa08d385dfd840227'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:44.544637 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff360006b4244caa08d385dfd840227'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:44.557219 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff360006b4244caa08d385dfd840227'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:44.567261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1389/2748] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:44 2022] DELETE /identity/v3/users/0ff360006b4244caa08d385dfd840227 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:44.571572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378dec6-d86e-442a-aa21-d34bff98f392 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:44.571858 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378dec6-d86e-442a-aa21-d34bff98f392 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:44.572167 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d378dec6-d86e-442a-aa21-d34bff98f392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:44.594237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d378dec6-d86e-442a-aa21-d34bff98f392 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:44.609791 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d378dec6-d86e-442a-aa21-d34bff98f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:44.681635 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1360/2749] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:44.688733 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:44.690933 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:44.778090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112b7641-0f13-444f-8d0b-303d38963ce2 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:44.782816 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f2047-4dd4-4eea-b934-aa6fa0e10a33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:44.783553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2047-4dd4-4eea-b934-aa6fa0e10a33 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:44.783836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2047-4dd4-4eea-b934-aa6fa0e10a33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:44.784137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8f2047-4dd4-4eea-b934-aa6fa0e10a33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:44.797829 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f2047-4dd4-4eea-b934-aa6fa0e10a33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:44.799421 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8f2047-4dd4-4eea-b934-aa6fa0e10a33 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:44.827305 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1390/2750] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:17:45.283219 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:45.396490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378dec6-d86e-442a-aa21-d34bff98f392 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:45.398352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d378dec6-d86e-442a-aa21-d34bff98f392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:45.418661 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d378dec6-d86e-442a-aa21-d34bff98f392 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:45.425651 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:45.426852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:45.427358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:45.427869 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] PATH_INFO: `/v3/projects/3e3320b37f08472aa0822ff2d35a6eb8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:45.429527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e3320b37f08472aa0822ff2d35a6eb8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:45.432521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:45.601673 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e3320b37f08472aa0822ff2d35a6eb8', 'request_id': 'req-bd51b49b-6926-4910-8d97-60848f09aad8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:45.609734 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e3320b37f08472aa0822ff2d35a6eb8', 'request_id': 'req-bd51b49b-6926-4910-8d97-60848f09aad8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:45.707720 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e3320b37f08472aa0822ff2d35a6eb8', 'request_id': 'req-bd51b49b-6926-4910-8d97-60848f09aad8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:45.734429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] The token cache is being invalidate because project 3e3320b37f08472aa0822ff2d35a6eb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:45.734429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:45.736353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:45.740747 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:45.743505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1361/2751] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:45 2022] DELETE /identity/v3/projects/3e3320b37f08472aa0822ff2d35a6eb8 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:45.743903 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f2047-4dd4-4eea-b934-aa6fa0e10a33 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:45.756577 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8f2047-4dd4-4eea-b934-aa6fa0e10a33 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:45.827410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:45.829165 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:45.833149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:45.833149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] PATH_INFO: `/v3/users/f9c0c7f5d461496f925ee9015550c484` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:45.833149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c0c7f5d461496f925ee9015550c484)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:45.834527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:46.088942 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c0c7f5d461496f925ee9015550c484'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:46.178255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c0c7f5d461496f925ee9015550c484'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:46.196891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c0c7f5d461496f925ee9015550c484'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:46.198675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c0c7f5d461496f925ee9015550c484'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:46.232163 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c0c7f5d461496f925ee9015550c484'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:46.234964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:46.240678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1391/2752] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:45 2022] DELETE /identity/v3/users/f9c0c7f5d461496f925ee9015550c484 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:46.382664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:46.836289 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:46.839151 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:46.847553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:46.851892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:46.879884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51b49b-6926-4910-8d97-60848f09aad8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:46.972656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8898eb-f259-46be-826e-284f935e2f56 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:46.980842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:46.982273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:46.982771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:46.983237 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] PATH_INFO: `/v3/users/3739928f43be4c20b131ed39101d49f9` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:46.985554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3739928f43be4c20b131ed39101d49f9)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:46.988977 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:46.998500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:47.001148 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:47.002036 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:47.005178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:47.005178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] PATH_INFO: `/v3/projects/a185539696904abbbc7c52437c42ccb5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:47.005178 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a185539696904abbbc7c52437c42ccb5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:47.005980 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:47.144717 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a185539696904abbbc7c52437c42ccb5', 'request_id': 'req-a7163f68-7c22-41b9-86d4-017014cb177f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:47.151823 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a185539696904abbbc7c52437c42ccb5', 'request_id': 'req-a7163f68-7c22-41b9-86d4-017014cb177f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:47.242992 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:47.268732 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a185539696904abbbc7c52437c42ccb5', 'request_id': 'req-a7163f68-7c22-41b9-86d4-017014cb177f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:47.287221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] The token cache is being invalidate because project a185539696904abbbc7c52437c42ccb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:47.287668 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:47.288505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a7163f68-7c22-41b9-86d4-017014cb177f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:47.288891 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3739928f43be4c20b131ed39101d49f9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:47.294697 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1362/2753] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:46 2022] DELETE /identity/v3/projects/a185539696904abbbc7c52437c42ccb5 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:47.296377 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677907d3-52ec-444d-808d-30f246ad2db0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:47.296884 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677907d3-52ec-444d-808d-30f246ad2db0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:47.297267 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677907d3-52ec-444d-808d-30f246ad2db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:47.320521 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-677907d3-52ec-444d-808d-30f246ad2db0 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:47.321927 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-677907d3-52ec-444d-808d-30f246ad2db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:47.397613 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1363/2754] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:47.406296 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9faf89b-af8b-4e6d-9a44-8164e7442eba None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:47.406584 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9faf89b-af8b-4e6d-9a44-8164e7442eba None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:47.406862 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9faf89b-af8b-4e6d-9a44-8164e7442eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:47.413899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3739928f43be4c20b131ed39101d49f9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:47.423202 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3739928f43be4c20b131ed39101d49f9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:47.424121 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3739928f43be4c20b131ed39101d49f9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:47.428629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b9faf89b-af8b-4e6d-9a44-8164e7442eba None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:47.429863 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b9faf89b-af8b-4e6d-9a44-8164e7442eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:47.440149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-0770cb32-a3bb-4c49-bea8-a5f96e6349f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3739928f43be4c20b131ed39101d49f9'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:47.441084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1364/2755] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:47.445662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9faf89b-af8b-4e6d-9a44-8164e7442eba None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:47.452159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1392/2756] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:46 2022] DELETE /identity/v3/users/3739928f43be4c20b131ed39101d49f9 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:47.463202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9faf89b-af8b-4e6d-9a44-8164e7442eba None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:47.468299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cf418-fc9d-4c25-b28f-185f95c28495 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:47.468819 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cf418-fc9d-4c25-b28f-185f95c28495 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:47.469352 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cf418-fc9d-4c25-b28f-185f95c28495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:47.491166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-706cf418-fc9d-4c25-b28f-185f95c28495 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:47.495570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-706cf418-fc9d-4c25-b28f-185f95c28495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:47.562920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed194e62-0efd-4f7e-b9eb-bacc0f6c8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:47.562920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed194e62-0efd-4f7e-b9eb-bacc0f6c8c40 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:47.562920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed194e62-0efd-4f7e-b9eb-bacc0f6c8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:47.562920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed194e62-0efd-4f7e-b9eb-bacc0f6c8c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:47.563839 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed194e62-0efd-4f7e-b9eb-bacc0f6c8c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:47.564142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed194e62-0efd-4f7e-b9eb-bacc0f6c8c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:47.565827 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed194e62-0efd-4f7e-b9eb-bacc0f6c8c40 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:47.582759 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1393/2757] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:47.585793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1365/2758] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:47.591682 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed194e62-0efd-4f7e-b9eb-bacc0f6c8c40 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:47.591908 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cf418-fc9d-4c25-b28f-185f95c28495 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:47.593714 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-706cf418-fc9d-4c25-b28f-185f95c28495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:47.609679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed194e62-0efd-4f7e-b9eb-bacc0f6c8c40 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:47.614049 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9d56-d79e-4767-86b3-018d9ef67dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:47.614802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9d56-d79e-4767-86b3-018d9ef67dce admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:47.615290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9d56-d79e-4767-86b3-018d9ef67dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:47.615653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a9d56-d79e-4767-86b3-018d9ef67dce admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:47.616469 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a9d56-d79e-4767-86b3-018d9ef67dce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:47.618554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a9d56-d79e-4767-86b3-018d9ef67dce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:47.671266 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cf418-fc9d-4c25-b28f-185f95c28495 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:47.675557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803a0c-2f6d-4c94-8777-95daffb748f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:47.676240 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803a0c-2f6d-4c94-8777-95daffb748f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:47.676523 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803a0c-2f6d-4c94-8777-95daffb748f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:47.676799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5803a0c-2f6d-4c94-8777-95daffb748f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:47.687067 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5803a0c-2f6d-4c94-8777-95daffb748f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:47.688567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5803a0c-2f6d-4c94-8777-95daffb748f9 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:47.700417 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1394/2759] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:47.701803 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:47.759751 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1366/2760] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:47 2022] POST /identity/v3/projects => generated 399 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:47.764773 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803a0c-2f6d-4c94-8777-95daffb748f9 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:47.782123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5803a0c-2f6d-4c94-8777-95daffb748f9 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:47.889156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6c63b-6358-4420-b200-805975ff28f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:47.907040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c63b-6358-4420-b200-805975ff28f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:47.907339 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c63b-6358-4420-b200-805975ff28f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:47.907617 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6c63b-6358-4420-b200-805975ff28f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:47.908389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6c63b-6358-4420-b200-805975ff28f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:47.912799 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6c63b-6358-4420-b200-805975ff28f9 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:48.032937 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1395/2761] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:47 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:48.037636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9d56-d79e-4767-86b3-018d9ef67dce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:48.051086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a9d56-d79e-4767-86b3-018d9ef67dce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:48.056392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fe5b5-a361-43bf-a416-ec99e41e8b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:48.058229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fe5b5-a361-43bf-a416-ec99e41e8b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:48.058515 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fe5b5-a361-43bf-a416-ec99e41e8b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:48.059003 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fe5b5-a361-43bf-a416-ec99e41e8b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:48.059975 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fe5b5-a361-43bf-a416-ec99e41e8b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:48.061575 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fe5b5-a361-43bf-a416-ec99e41e8b9b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:48.092620 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1367/2762] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:48.098773 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6c63b-6358-4420-b200-805975ff28f9 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:48.115633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6c63b-6358-4420-b200-805975ff28f9 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:48.124650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb3c7-3a97-4b94-87bb-95e8950e823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:48.125715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb3c7-3a97-4b94-87bb-95e8950e823a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:48.126611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb3c7-3a97-4b94-87bb-95e8950e823a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:48.127365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadb3c7-3a97-4b94-87bb-95e8950e823a admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:48.130996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadb3c7-3a97-4b94-87bb-95e8950e823a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:48.138203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadb3c7-3a97-4b94-87bb-95e8950e823a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:48.154090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1396/2763] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:48 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:48.155027 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:48.158747 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fe5b5-a361-43bf-a416-ec99e41e8b9b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:48.171221 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fe5b5-a361-43bf-a416-ec99e41e8b9b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:48.177176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2fd82-abda-46a4-ba7d-cb7e7b9042f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:48.178309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2fd82-abda-46a4-ba7d-cb7e7b9042f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:48.178811 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2fd82-abda-46a4-ba7d-cb7e7b9042f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:48.179759 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2fd82-abda-46a4-ba7d-cb7e7b9042f6 admin admin] PATH_INFO: `/v3/projects/0d7f6a68984942d487cb739ffe22ea90/users/eb7ff6c95b9341fbaeb04ff13bbad0aa/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:48.201368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2fd82-abda-46a4-ba7d-cb7e7b9042f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d7f6a68984942d487cb739ffe22ea90, user_id=eb7ff6c95b9341fbaeb04ff13bbad0aa, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:48.206018 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2fd82-abda-46a4-ba7d-cb7e7b9042f6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:48.218526 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb3c7-3a97-4b94-87bb-95e8950e823a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:48.220609 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1cadb3c7-3a97-4b94-87bb-95e8950e823a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:48.241866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadb3c7-3a97-4b94-87bb-95e8950e823a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:48.253540 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:48.254830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:48.255290 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:48.255667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] PATH_INFO: `/v3/projects/86c663bd943b423da99448a31d60f516` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:48.257394 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c663bd943b423da99448a31d60f516)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:48.259501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:48.318303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1368/2764] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:48 2022] PUT /identity/v3/projects/0d7f6a68984942d487cb739ffe22ea90/users/eb7ff6c95b9341fbaeb04ff13bbad0aa/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:48.331237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ae65c-c2d0-4310-9d9b-385573df572e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:48.331776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ae65c-c2d0-4310-9d9b-385573df572e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:48.332091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ae65c-c2d0-4310-9d9b-385573df572e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:48.334451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:48.373578 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-752ae65c-c2d0-4310-9d9b-385573df572e None None] MFA Rules not processed for user `eb7ff6c95b9341fbaeb04ff13bbad0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:48.374815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-752ae65c-c2d0-4310-9d9b-385573df572e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:48.412743 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c663bd943b423da99448a31d60f516', 'request_id': 'req-99f16b87-748e-4c3f-a457-3e8d1b7fff13'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:48.430022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c663bd943b423da99448a31d60f516', 'request_id': 'req-99f16b87-748e-4c3f-a457-3e8d1b7fff13'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:48.473210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1369/2765] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:17:48.478096 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ae65c-c2d0-4310-9d9b-385573df572e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:48.509122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c663bd943b423da99448a31d60f516', 'request_id': 'req-99f16b87-748e-4c3f-a457-3e8d1b7fff13'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:48.529475 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] The token cache is being invalidate because project 86c663bd943b423da99448a31d60f516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:48.529777 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:48.530484 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:48.532912 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1397/2766] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:48 2022] DELETE /identity/v3/projects/86c663bd943b423da99448a31d60f516 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:48.536878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:48.538521 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:48.561806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ae65c-c2d0-4310-9d9b-385573df572e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:48.631687 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f16b87-748e-4c3f-a457-3e8d1b7fff13 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:48.636807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:48.637205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78705838-031d-48ef-aff6-13f0178b431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:48.637698 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:48.637898 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78705838-031d-48ef-aff6-13f0178b431f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:48.638079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:48.638175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78705838-031d-48ef-aff6-13f0178b431f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:48.638280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] PATH_INFO: `/v3/users/7d5a28e4dacf43b4979c61b93f93a5aa` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:48.638534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78705838-031d-48ef-aff6-13f0178b431f admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:48.639077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78705838-031d-48ef-aff6-13f0178b431f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:48.639632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5a28e4dacf43b4979c61b93f93a5aa)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:48.641023 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78705838-031d-48ef-aff6-13f0178b431f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:48.641657 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:48.920351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1370/2767] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:48 2022] POST /identity/v3/projects => generated 399 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:48.924803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78705838-031d-48ef-aff6-13f0178b431f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:48.926487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-78705838-031d-48ef-aff6-13f0178b431f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:48.997976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78705838-031d-48ef-aff6-13f0178b431f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:49.002657 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8707-b155-4d91-aaf1-0eb5912bf725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:49.003350 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8707-b155-4d91-aaf1-0eb5912bf725 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:49.003629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8707-b155-4d91-aaf1-0eb5912bf725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:49.003902 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb8707-b155-4d91-aaf1-0eb5912bf725 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:49.004611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8707-b155-4d91-aaf1-0eb5912bf725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:49.006615 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb8707-b155-4d91-aaf1-0eb5912bf725 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:49.081624 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5a28e4dacf43b4979c61b93f93a5aa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:49.188828 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1371/2768] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:48 2022] POST /identity/v3/users => generated 306 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:17:49.192841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8707-b155-4d91-aaf1-0eb5912bf725 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:49.203841 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb8707-b155-4d91-aaf1-0eb5912bf725 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:49.209953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5a28e4dacf43b4979c61b93f93a5aa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:49.210077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c9181-e090-4472-81e5-f1b0d533caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:49.210077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c9181-e090-4472-81e5-f1b0d533caa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:49.210077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c9181-e090-4472-81e5-f1b0d533caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:49.210077 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c9181-e090-4472-81e5-f1b0d533caa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:49.210845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c9181-e090-4472-81e5-f1b0d533caa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:49.212471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5c9181-e090-4472-81e5-f1b0d533caa6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:49.213984 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5a28e4dacf43b4979c61b93f93a5aa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:49.214655 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5a28e4dacf43b4979c61b93f93a5aa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:49.223328 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1372/2769] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:49.226777 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5a28e4dacf43b4979c61b93f93a5aa'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:49.227426 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c9181-e090-4472-81e5-f1b0d533caa6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:49.229258 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1e5c9181-e090-4472-81e5-f1b0d533caa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:49.236604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1398/2770] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:48 2022] DELETE /identity/v3/users/7d5a28e4dacf43b4979c61b93f93a5aa => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:49.243240 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5c9181-e090-4472-81e5-f1b0d533caa6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:49.311746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9f445-0515-447f-bfed-521b8d272b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:49.311746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f445-0515-447f-bfed-521b8d272b64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:49.311746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f445-0515-447f-bfed-521b8d272b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:49.311746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d9f445-0515-447f-bfed-521b8d272b64 admin admin] PATH_INFO: `/v3/projects/853cbb44c4f24c8a8ca217787692c848/users/5691fe35190b4445b07a5056d589e758/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:49.333802 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9f445-0515-447f-bfed-521b8d272b64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=853cbb44c4f24c8a8ca217787692c848, user_id=5691fe35190b4445b07a5056d589e758, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:49.339511 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d9f445-0515-447f-bfed-521b8d272b64 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:49.425827 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1373/2771] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:49 2022] PUT /identity/v3/projects/853cbb44c4f24c8a8ca217787692c848/users/5691fe35190b4445b07a5056d589e758/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:49.430273 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:49.444239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbae985-f469-48e3-a848-d9abf4849a66 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:49.547807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd04a5-ad5b-40a0-85e6-fd412409c26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:49.548644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd04a5-ad5b-40a0-85e6-fd412409c26f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:49.548909 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd04a5-ad5b-40a0-85e6-fd412409c26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:49.549181 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd04a5-ad5b-40a0-85e6-fd412409c26f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:49.549912 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd04a5-ad5b-40a0-85e6-fd412409c26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:49.551508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccd04a5-ad5b-40a0-85e6-fd412409c26f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:49.568280 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1399/2772] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:49.569820 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9f445-0515-447f-bfed-521b8d272b64 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:49.583019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d9f445-0515-447f-bfed-521b8d272b64 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:49.591386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f7d15-fc1d-4181-9ec3-450eec3f8e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:49.591386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f7d15-fc1d-4181-9ec3-450eec3f8e6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:49.591386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f7d15-fc1d-4181-9ec3-450eec3f8e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:49.591386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f7d15-fc1d-4181-9ec3-450eec3f8e6e admin admin] PATH_INFO: `/v3/projects/853cbb44c4f24c8a8ca217787692c848/users/5691fe35190b4445b07a5056d589e758/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:49.593479 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f7d15-fc1d-4181-9ec3-450eec3f8e6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=853cbb44c4f24c8a8ca217787692c848, user_id=5691fe35190b4445b07a5056d589e758, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:49.596365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722f7d15-fc1d-4181-9ec3-450eec3f8e6e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:49.609051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1374/2773] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:49 2022] PUT /identity/v3/projects/853cbb44c4f24c8a8ca217787692c848/users/5691fe35190b4445b07a5056d589e758/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:49.613938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:49.619731 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b2a80-89b9-486f-8ea7-08158beac402 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:49.620098 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b2a80-89b9-486f-8ea7-08158beac402 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:49.620378 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b2a80-89b9-486f-8ea7-08158beac402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:49.657322 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-ae3b2a80-89b9-486f-8ea7-08158beac402 None None] MFA Rules not processed for user `5691fe35190b4445b07a5056d589e758`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:49.658549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ae3b2a80-89b9-486f-8ea7-08158beac402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:49.734678 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:49.743545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1400/2774] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:49 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:49.755357 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f7d15-fc1d-4181-9ec3-450eec3f8e6e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:49.757096 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-722f7d15-fc1d-4181-9ec3-450eec3f8e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:49.813766 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722f7d15-fc1d-4181-9ec3-450eec3f8e6e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:49.817364 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8fb28-8831-47ae-9745-acd60d876fe9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:49.818001 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8fb28-8831-47ae-9745-acd60d876fe9 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:49.818338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8fb28-8831-47ae-9745-acd60d876fe9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:49.818624 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8fb28-8831-47ae-9745-acd60d876fe9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:49.828225 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8fb28-8831-47ae-9745-acd60d876fe9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:49.830254 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8fb28-8831-47ae-9745-acd60d876fe9 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:49.839526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1375/2775] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:49 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:49.874298 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b2a80-89b9-486f-8ea7-08158beac402 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:49.875831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ae3b2a80-89b9-486f-8ea7-08158beac402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:49.954492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b2a80-89b9-486f-8ea7-08158beac402 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:49.964985 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:49.965892 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:49.966167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:49.966432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] PATH_INFO: `/v3/projects/5f9ac3d03ac04df4b156fd45993282d6` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:49.967665 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9ac3d03ac04df4b156fd45993282d6)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:49.969791 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:50.115242 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9ac3d03ac04df4b156fd45993282d6', 'request_id': 'req-746916b7-0491-4312-803f-36b36a313270'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:50.120707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9ac3d03ac04df4b156fd45993282d6', 'request_id': 'req-746916b7-0491-4312-803f-36b36a313270'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:50.146236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8fb28-8831-47ae-9745-acd60d876fe9 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:50.155930 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8fb28-8831-47ae-9745-acd60d876fe9 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:50.212029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9ac3d03ac04df4b156fd45993282d6', 'request_id': 'req-746916b7-0491-4312-803f-36b36a313270'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:50.222237 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcef265-1681-4d69-acf2-34b73a155521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:50.222922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcef265-1681-4d69-acf2-34b73a155521 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:50.223213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcef265-1681-4d69-acf2-34b73a155521 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:50.223628 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcef265-1681-4d69-acf2-34b73a155521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:50.229259 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] The token cache is being invalidate because project 5f9ac3d03ac04df4b156fd45993282d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:50.229593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:50.230459 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-746916b7-0491-4312-803f-36b36a313270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:50.232413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dfcef265-1681-4d69-acf2-34b73a155521 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:50.233626 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1401/2776] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:49 2022] DELETE /identity/v3/projects/5f9ac3d03ac04df4b156fd45993282d6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:50.239429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c1f43-9f04-4938-9d7e-1be702f5f729 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:50.239783 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c1f43-9f04-4938-9d7e-1be702f5f729 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:50.240118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c1f43-9f04-4938-9d7e-1be702f5f729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:50.322572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcef265-1681-4d69-acf2-34b73a155521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:50.324659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcef265-1681-4d69-acf2-34b73a155521 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:50.337018 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1376/2777] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:17:50.390005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d127d-fa2b-468c-9ca4-d14d0419e799 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:50.401971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:50.403129 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d127d-fa2b-468c-9ca4-d14d0419e799 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:50.403437 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d127d-fa2b-468c-9ca4-d14d0419e799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:50.414558 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-494c1f43-9f04-4938-9d7e-1be702f5f729 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:50.416115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-494c1f43-9f04-4938-9d7e-1be702f5f729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:50.426976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-555d127d-fa2b-468c-9ca4-d14d0419e799 None None] MFA Rules not processed for user `9a34c34832ea44a7bec9ec48eddeebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:50.430696 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-555d127d-fa2b-468c-9ca4-d14d0419e799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:50.489383 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1402/2778] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:50.498856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1255b6-dd5e-4a51-b26d-50aa47f258d4 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:50.500018 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1255b6-dd5e-4a51-b26d-50aa47f258d4 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:50.500397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1255b6-dd5e-4a51-b26d-50aa47f258d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:50.508203 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1377/2779] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:50.524463 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-1d1255b6-dd5e-4a51-b26d-50aa47f258d4 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:50.525973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1d1255b6-dd5e-4a51-b26d-50aa47f258d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:50.533969 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1403/2780] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:17:50.538260 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d127d-fa2b-468c-9ca4-d14d0419e799 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:50.549094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d127d-fa2b-468c-9ca4-d14d0419e799 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:50.551690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:50.554109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69859db0-7b36-450b-9667-b8359bf4f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:50.561706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859db0-7b36-450b-9667-b8359bf4f0da admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:50.561706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859db0-7b36-450b-9667-b8359bf4f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:50.561706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859db0-7b36-450b-9667-b8359bf4f0da admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:50.561706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69859db0-7b36-450b-9667-b8359bf4f0da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:50.561706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69859db0-7b36-450b-9667-b8359bf4f0da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:50.561706 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69859db0-7b36-450b-9667-b8359bf4f0da admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:50.571018 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1378/2781] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:50.576022 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1255b6-dd5e-4a51-b26d-50aa47f258d4 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:50.585573 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:50.585715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1255b6-dd5e-4a51-b26d-50aa47f258d4 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:50.590557 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12097b-607b-4b64-92c9-931f851add6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:50.591312 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12097b-607b-4b64-92c9-931f851add6c admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:50.591598 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12097b-607b-4b64-92c9-931f851add6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:50.591887 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf12097b-607b-4b64-92c9-931f851add6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:50.592675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12097b-607b-4b64-92c9-931f851add6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:50.594639 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf12097b-607b-4b64-92c9-931f851add6c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:50.688769 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1404/2782] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:50 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:50.692994 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69859db0-7b36-450b-9667-b8359bf4f0da admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:50.706074 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69859db0-7b36-450b-9667-b8359bf4f0da admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:50.766981 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16dae-3b15-4aaa-80f4-33db4bb04fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:50.769964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16dae-3b15-4aaa-80f4-33db4bb04fc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:50.769964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16dae-3b15-4aaa-80f4-33db4bb04fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:50.769964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd16dae-3b15-4aaa-80f4-33db4bb04fc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:50.769964 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16dae-3b15-4aaa-80f4-33db4bb04fc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:50.770776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd16dae-3b15-4aaa-80f4-33db4bb04fc6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:50.817530 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:50.874452 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1379/2783] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:50 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:50.878595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12097b-607b-4b64-92c9-931f851add6c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:50.889816 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf12097b-607b-4b64-92c9-931f851add6c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:50.894614 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fa9b2-e0b0-458e-a89f-6109111efb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:50.895272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fa9b2-e0b0-458e-a89f-6109111efb62 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:50.895552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fa9b2-e0b0-458e-a89f-6109111efb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:50.895824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8fa9b2-e0b0-458e-a89f-6109111efb62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:50.896600 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fa9b2-e0b0-458e-a89f-6109111efb62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:50.898187 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8fa9b2-e0b0-458e-a89f-6109111efb62 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:50.908466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:50.911552 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1405/2784] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:50.915554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16dae-3b15-4aaa-80f4-33db4bb04fc6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:50.926789 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd16dae-3b15-4aaa-80f4-33db4bb04fc6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:50.932278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aad9617-96fd-4bfa-ade6-782236fd3d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:50.932910 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9617-96fd-4bfa-ade6-782236fd3d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:50.933186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9617-96fd-4bfa-ade6-782236fd3d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:50.933459 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aad9617-96fd-4bfa-ade6-782236fd3d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:50.934227 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad9617-96fd-4bfa-ade6-782236fd3d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:50.935867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aad9617-96fd-4bfa-ade6-782236fd3d39 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:50.949676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1380/2785] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:50.950817 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fa9b2-e0b0-458e-a89f-6109111efb62 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:50.968845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8fa9b2-e0b0-458e-a89f-6109111efb62 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:50.974292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7029ae-1ff8-43cf-b654-b965fa1efdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:50.978694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7029ae-1ff8-43cf-b654-b965fa1efdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:50.978694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7029ae-1ff8-43cf-b654-b965fa1efdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:50.978694 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7029ae-1ff8-43cf-b654-b965fa1efdb5 admin admin] PATH_INFO: `/v3/projects/5db7af57d134480198779aee3999104e/users/195c3773192e42429267935eaff90412/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:50.991428 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7029ae-1ff8-43cf-b654-b965fa1efdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5db7af57d134480198779aee3999104e, user_id=195c3773192e42429267935eaff90412, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:50.994848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7029ae-1ff8-43cf-b654-b965fa1efdb5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:51.174553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1406/2786] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:50 2022] PUT /identity/v3/projects/5db7af57d134480198779aee3999104e/users/195c3773192e42429267935eaff90412/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:51.185909 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f964eb-c3fc-4847-accf-7f96a2db7be0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:51.186109 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f964eb-c3fc-4847-accf-7f96a2db7be0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:51.186391 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f964eb-c3fc-4847-accf-7f96a2db7be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:51.214827 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-34f964eb-c3fc-4847-accf-7f96a2db7be0 None None] MFA Rules not processed for user `195c3773192e42429267935eaff90412`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:51.216065 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-34f964eb-c3fc-4847-accf-7f96a2db7be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:51.293002 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1381/2787] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:51.305442 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7029ae-1ff8-43cf-b654-b965fa1efdb5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:51.308106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9b7029ae-1ff8-43cf-b654-b965fa1efdb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:51.370642 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7029ae-1ff8-43cf-b654-b965fa1efdb5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:51.376082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964969b5-29b5-46b3-8890-83de23f8f023 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:51.376736 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964969b5-29b5-46b3-8890-83de23f8f023 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:51.377019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964969b5-29b5-46b3-8890-83de23f8f023 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:51.379195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964969b5-29b5-46b3-8890-83de23f8f023 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:51.389559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964969b5-29b5-46b3-8890-83de23f8f023 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:51.391251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964969b5-29b5-46b3-8890-83de23f8f023 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:51.400809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1407/2788] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:51.421400 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f964eb-c3fc-4847-accf-7f96a2db7be0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:51.462217 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:51.487633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f964eb-c3fc-4847-accf-7f96a2db7be0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:51.492146 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:51.493012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:51.493294 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:51.493565 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] PATH_INFO: `/v3/users/195c3773192e42429267935eaff90412` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:51.495667 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] RBAC: Authorizing `identity:delete_user(user_id=195c3773192e42429267935eaff90412)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:51.497618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:51.554742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:51.673798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195c3773192e42429267935eaff90412'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:51.693583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195c3773192e42429267935eaff90412'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:51.702874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195c3773192e42429267935eaff90412'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:51.703666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195c3773192e42429267935eaff90412'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:51.704353 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195c3773192e42429267935eaff90412'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:51.771679 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1382/2789] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:51 2022] DELETE /identity/v3/users/195c3773192e42429267935eaff90412 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:17:51.777584 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d5ec9-1fda-47b7-810e-c463ef3e9fb8 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:51.778559 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d5ec9-1fda-47b7-810e-c463ef3e9fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:51.778869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276d5ec9-1fda-47b7-810e-c463ef3e9fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:51.799326 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-276d5ec9-1fda-47b7-810e-c463ef3e9fb8 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:51.800697 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-276d5ec9-1fda-47b7-810e-c463ef3e9fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:51.872194 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:51.875560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1408/2790] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:17:51.887068 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:51.888935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:51.962026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ef037e-262e-419d-9d60-ec800d42341a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:51.967103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375290f-9208-4175-b266-6f75635cfd33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:51.967778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375290f-9208-4175-b266-6f75635cfd33 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:51.968090 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375290f-9208-4175-b266-6f75635cfd33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:51.968365 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4375290f-9208-4175-b266-6f75635cfd33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:51.979730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375290f-9208-4175-b266-6f75635cfd33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:51.981304 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4375290f-9208-4175-b266-6f75635cfd33 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:51.992170 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1383/2791] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:52.051068 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d5ec9-1fda-47b7-810e-c463ef3e9fb8 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:52.052784 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-276d5ec9-1fda-47b7-810e-c463ef3e9fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:52.068666 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276d5ec9-1fda-47b7-810e-c463ef3e9fb8 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:52.072831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0846634b-1fbc-4a58-8df8-f4b381d378c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:52.073485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846634b-1fbc-4a58-8df8-f4b381d378c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:52.073766 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846634b-1fbc-4a58-8df8-f4b381d378c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:52.074041 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0846634b-1fbc-4a58-8df8-f4b381d378c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:52.075958 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-0846634b-1fbc-4a58-8df8-f4b381d378c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:52.148902 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846634b-1fbc-4a58-8df8-f4b381d378c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:52.151045 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0846634b-1fbc-4a58-8df8-f4b381d378c5 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:52.161449 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1409/2792] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:52.577846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375290f-9208-4175-b266-6f75635cfd33 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:52.579451 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4375290f-9208-4175-b266-6f75635cfd33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:52.593144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4375290f-9208-4175-b266-6f75635cfd33 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:52.597783 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:52.598629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:52.598908 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:52.599186 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] PATH_INFO: `/v3/projects/5db7af57d134480198779aee3999104e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:52.600386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5db7af57d134480198779aee3999104e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:52.602371 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:52.753320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5db7af57d134480198779aee3999104e', 'request_id': 'req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:52.755411 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:52.762007 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5db7af57d134480198779aee3999104e', 'request_id': 'req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:52.872629 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5db7af57d134480198779aee3999104e', 'request_id': 'req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:52.885557 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] The token cache is being invalidate because project 5db7af57d134480198779aee3999104e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:52.885989 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:52.887428 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eefc2d6f-57f5-4948-b5fb-a15d3a7d9ca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:52.891963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1384/2793] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:52 2022] DELETE /identity/v3/projects/5db7af57d134480198779aee3999104e => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:52.894595 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4365a12-93cb-4cf9-bdad-eebb08e1c23a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:52.895084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4365a12-93cb-4cf9-bdad-eebb08e1c23a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:52.895200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4365a12-93cb-4cf9-bdad-eebb08e1c23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:52.913606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-c4365a12-93cb-4cf9-bdad-eebb08e1c23a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:52.914836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c4365a12-93cb-4cf9-bdad-eebb08e1c23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:52.991134 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1410/2794] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:53.055962 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10b1f6-b7be-4982-8cb7-cea6ca3277f9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:53.056208 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10b1f6-b7be-4982-8cb7-cea6ca3277f9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:53.057032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10b1f6-b7be-4982-8cb7-cea6ca3277f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:53.080280 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8a10b1f6-b7be-4982-8cb7-cea6ca3277f9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:53.083585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8a10b1f6-b7be-4982-8cb7-cea6ca3277f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:53.091553 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1385/2795] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:53.096029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4365a12-93cb-4cf9-bdad-eebb08e1c23a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:53.108216 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4365a12-93cb-4cf9-bdad-eebb08e1c23a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:53.113788 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1459f-2fb3-467d-a517-2fe4acb20f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:53.114498 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1459f-2fb3-467d-a517-2fe4acb20f9c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:53.114953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1459f-2fb3-467d-a517-2fe4acb20f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:53.115385 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1459f-2fb3-467d-a517-2fe4acb20f9c admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:53.117115 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1459f-2fb3-467d-a517-2fe4acb20f9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:53.117593 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1459f-2fb3-467d-a517-2fe4acb20f9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:53.120235 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1459f-2fb3-467d-a517-2fe4acb20f9c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:53.133576 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1411/2796] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:53.138714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10b1f6-b7be-4982-8cb7-cea6ca3277f9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:53.150308 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10b1f6-b7be-4982-8cb7-cea6ca3277f9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:53.156019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798b735-1f23-4325-88fc-172a80725103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:53.159588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b735-1f23-4325-88fc-172a80725103 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:53.159588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b735-1f23-4325-88fc-172a80725103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:53.159588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e798b735-1f23-4325-88fc-172a80725103 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:53.159588 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798b735-1f23-4325-88fc-172a80725103 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:53.160042 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e798b735-1f23-4325-88fc-172a80725103 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:53.239640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1459f-2fb3-467d-a517-2fe4acb20f9c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:53.241640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a4a1459f-2fb3-467d-a517-2fe4acb20f9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:53.276225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:53.279126 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1386/2797] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:53 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:53.283565 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798b735-1f23-4325-88fc-172a80725103 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:53.354380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1459f-2fb3-467d-a517-2fe4acb20f9c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:53.356209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e798b735-1f23-4325-88fc-172a80725103 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:53.361481 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642032a5-7673-4297-bf33-7149ef7ff515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:53.362362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642032a5-7673-4297-bf33-7149ef7ff515 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:53.362825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642032a5-7673-4297-bf33-7149ef7ff515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:53.363255 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642032a5-7673-4297-bf33-7149ef7ff515 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:53.364128 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642032a5-7673-4297-bf33-7149ef7ff515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:53.366361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642032a5-7673-4297-bf33-7149ef7ff515 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:53.420724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e218d-6d7a-4d4f-9d6e-e54013c61d55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e52a3464d8f4a3fa16a102336a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:53.421390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e218d-6d7a-4d4f-9d6e-e54013c61d55 service placement] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:53.421674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e218d-6d7a-4d4f-9d6e-e54013c61d55 service placement] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:53.421949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209e218d-6d7a-4d4f-9d6e-e54013c61d55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:53.423765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-209e218d-6d7a-4d4f-9d6e-e54013c61d55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:53.435606 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e218d-6d7a-4d4f-9d6e-e54013c61d55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:53.437272 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209e218d-6d7a-4d4f-9d6e-e54013c61d55 service placement] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:53.447570 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1412/2798] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:17:53.479714 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1387/2799] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:53 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:17:53.482042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e218d-6d7a-4d4f-9d6e-e54013c61d55 service placement] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:53.492412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209e218d-6d7a-4d4f-9d6e-e54013c61d55 service placement] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:53.498935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e8a53-832a-42be-9ef2-0be306834950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:53.499605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e8a53-832a-42be-9ef2-0be306834950 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:53.499987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e8a53-832a-42be-9ef2-0be306834950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:53.500243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e8a53-832a-42be-9ef2-0be306834950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:53.501024 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e8a53-832a-42be-9ef2-0be306834950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:53.502675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e8a53-832a-42be-9ef2-0be306834950 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:53.513749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1413/2800] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:53.520744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642032a5-7673-4297-bf33-7149ef7ff515 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:53.533701 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642032a5-7673-4297-bf33-7149ef7ff515 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:53.538739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db21edde-e88e-4302-bd16-1892a211b5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:53.539593 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21edde-e88e-4302-bd16-1892a211b5d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:53.542685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21edde-e88e-4302-bd16-1892a211b5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:53.542685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db21edde-e88e-4302-bd16-1892a211b5d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:53.542685 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21edde-e88e-4302-bd16-1892a211b5d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:53.543990 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db21edde-e88e-4302-bd16-1892a211b5d9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:53.557812 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1388/2801] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:17:53.559099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e8a53-832a-42be-9ef2-0be306834950 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:53.569195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e8a53-832a-42be-9ef2-0be306834950 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:53.574581 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f99838-3acc-4803-9421-5a4e3836e400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:53.575460 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f99838-3acc-4803-9421-5a4e3836e400 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:53.575734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f99838-3acc-4803-9421-5a4e3836e400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:53.576027 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f99838-3acc-4803-9421-5a4e3836e400 admin admin] PATH_INFO: `/v3/projects/581bb2a5378844118c40e42f65804f8a/users/eb42bdf3d08b4282bbde04aa017667e2/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:53.594652 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f99838-3acc-4803-9421-5a4e3836e400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=581bb2a5378844118c40e42f65804f8a, user_id=eb42bdf3d08b4282bbde04aa017667e2, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:53.597447 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f99838-3acc-4803-9421-5a4e3836e400 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:53.710767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1414/2802] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:53 2022] PUT /identity/v3/projects/581bb2a5378844118c40e42f65804f8a/users/eb42bdf3d08b4282bbde04aa017667e2/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:53.721320 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1ad27-9587-4d5e-b87a-5c51dd076b2e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:53.722131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1ad27-9587-4d5e-b87a-5c51dd076b2e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:53.722131 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f1ad27-9587-4d5e-b87a-5c51dd076b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:53.757576 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-29f1ad27-9587-4d5e-b87a-5c51dd076b2e None None] MFA Rules not processed for user `eb42bdf3d08b4282bbde04aa017667e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:53.758816 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-29f1ad27-9587-4d5e-b87a-5c51dd076b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:53.828362 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1389/2803] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:53.833048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f99838-3acc-4803-9421-5a4e3836e400 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:53.927771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f99838-3acc-4803-9421-5a4e3836e400 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:53.927771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b2a61-bb9a-4bea-983c-e4a098963a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:53.927771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b2a61-bb9a-4bea-983c-e4a098963a3b admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:53.927771 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b2a61-bb9a-4bea-983c-e4a098963a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:53.928590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b2a61-bb9a-4bea-983c-e4a098963a3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:53.928590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b2a61-bb9a-4bea-983c-e4a098963a3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:53.928590 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b2a61-bb9a-4bea-983c-e4a098963a3b admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:53.932973 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:54.041137 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1415/2804] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:53 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:17:54.046351 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1ad27-9587-4d5e-b87a-5c51dd076b2e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:54.058953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f1ad27-9587-4d5e-b87a-5c51dd076b2e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:54.080338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:54.125659 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8473d-a60b-4049-8787-10c2b705b78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:54.126359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8473d-a60b-4049-8787-10c2b705b78f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:54.126664 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8473d-a60b-4049-8787-10c2b705b78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:54.126926 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d8473d-a60b-4049-8787-10c2b705b78f admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:54.127816 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8473d-a60b-4049-8787-10c2b705b78f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:54.129830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d8473d-a60b-4049-8787-10c2b705b78f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:54.253739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1390/2805] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:54 2022] POST /identity/v3/users => generated 292 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:54.255053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b2a61-bb9a-4bea-983c-e4a098963a3b admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:54.266376 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b2a61-bb9a-4bea-983c-e4a098963a3b admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:54.271179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc27744-14fe-48af-9470-49c8284656b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:54.275575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27744-14fe-48af-9470-49c8284656b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:54.275575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27744-14fe-48af-9470-49c8284656b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:54.275575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc27744-14fe-48af-9470-49c8284656b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:54.275575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc27744-14fe-48af-9470-49c8284656b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:54.275575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc27744-14fe-48af-9470-49c8284656b3 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:54.290739 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1416/2806] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:54.297064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8473d-a60b-4049-8787-10c2b705b78f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:54.307881 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d8473d-a60b-4049-8787-10c2b705b78f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:54.313100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5488355c-661f-4f13-91b2-7288e0e4e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:54.313765 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488355c-661f-4f13-91b2-7288e0e4e983 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:54.314046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488355c-661f-4f13-91b2-7288e0e4e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:54.314324 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488355c-661f-4f13-91b2-7288e0e4e983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:54.315087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488355c-661f-4f13-91b2-7288e0e4e983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:54.316725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5488355c-661f-4f13-91b2-7288e0e4e983 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:54.335978 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1391/2807] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:54.340646 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc27744-14fe-48af-9470-49c8284656b3 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:54.351023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc27744-14fe-48af-9470-49c8284656b3 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:54.357104 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991718d7-f728-454d-8937-42b2ffad984f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:54.358073 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991718d7-f728-454d-8937-42b2ffad984f admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:54.358357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991718d7-f728-454d-8937-42b2ffad984f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:54.358635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991718d7-f728-454d-8937-42b2ffad984f admin admin] PATH_INFO: `/v3/projects/7a71939fc6cd48f398b02cc98af463b5/users/0e0dd4890dac40518490a1d29581cd10/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:54.375284 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991718d7-f728-454d-8937-42b2ffad984f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a71939fc6cd48f398b02cc98af463b5, user_id=0e0dd4890dac40518490a1d29581cd10, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:54.377993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991718d7-f728-454d-8937-42b2ffad984f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:54.534476 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1417/2808] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:54 2022] PUT /identity/v3/projects/7a71939fc6cd48f398b02cc98af463b5/users/0e0dd4890dac40518490a1d29581cd10/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:54.550590 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1c0d-528e-4177-9a4d-0e09551803c3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:54.551394 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1c0d-528e-4177-9a4d-0e09551803c3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:54.551677 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a1c0d-528e-4177-9a4d-0e09551803c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:54.602675 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-834a1c0d-528e-4177-9a4d-0e09551803c3 None None] MFA Rules not processed for user `0e0dd4890dac40518490a1d29581cd10`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:54.604349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-834a1c0d-528e-4177-9a4d-0e09551803c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:54.693534 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991718d7-f728-454d-8937-42b2ffad984f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:54.695380 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-991718d7-f728-454d-8937-42b2ffad984f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:54.706899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1392/2809] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:54.707972 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1c0d-528e-4177-9a4d-0e09551803c3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:54.821961 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a1c0d-528e-4177-9a4d-0e09551803c3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:54.828547 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d3ecd5-e759-4748-992c-fc8342232253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:54.829446 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3ecd5-e759-4748-992c-fc8342232253 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:54.829997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3ecd5-e759-4748-992c-fc8342232253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:54.830648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d3ecd5-e759-4748-992c-fc8342232253 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:54.831476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3ecd5-e759-4748-992c-fc8342232253 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:54.834410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d3ecd5-e759-4748-992c-fc8342232253 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:54.845439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991718d7-f728-454d-8937-42b2ffad984f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:54.859182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1a66-e5d8-40dd-a8c4-d666172414b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:54.859847 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1a66-e5d8-40dd-a8c4-d666172414b6 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:54.860254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1a66-e5d8-40dd-a8c4-d666172414b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:54.860539 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1a66-e5d8-40dd-a8c4-d666172414b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:54.862437 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-517a1a66-e5d8-40dd-a8c4-d666172414b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:54.883508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a1a66-e5d8-40dd-a8c4-d666172414b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:54.883508 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517a1a66-e5d8-40dd-a8c4-d666172414b6 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:54.897201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1418/2810] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:17:54.951877 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1393/2811] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:54 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:54.956206 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1a66-e5d8-40dd-a8c4-d666172414b6 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:54.977432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517a1a66-e5d8-40dd-a8c4-d666172414b6 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:55.099043 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11079b87-55e8-4afd-bd86-709ba0e65347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:55.099737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11079b87-55e8-4afd-bd86-709ba0e65347 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:55.100054 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11079b87-55e8-4afd-bd86-709ba0e65347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:55.100825 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11079b87-55e8-4afd-bd86-709ba0e65347 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:55.101039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11079b87-55e8-4afd-bd86-709ba0e65347 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:55.102976 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11079b87-55e8-4afd-bd86-709ba0e65347 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:55.126912 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa8ad8-04f7-4a23-9c84-8c52292a431c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:55.127214 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa8ad8-04f7-4a23-9c84-8c52292a431c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:55.127951 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa8ad8-04f7-4a23-9c84-8c52292a431c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:55.147299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aafa8ad8-04f7-4a23-9c84-8c52292a431c None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:55.148581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aafa8ad8-04f7-4a23-9c84-8c52292a431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:55.158512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:55.217080 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1394/2812] 10.222.0.85 () {58 vars in 1009 bytes} [Wed Jul 20 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:17:55.233377 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa8ad8-04f7-4a23-9c84-8c52292a431c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:55.234815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aafa8ad8-04f7-4a23-9c84-8c52292a431c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:55.244030 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:55.253236 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1419/2813] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:54 2022] POST /identity/v3/users => generated 296 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:55.257201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11079b87-55e8-4afd-bd86-709ba0e65347 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:55.268664 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11079b87-55e8-4afd-bd86-709ba0e65347 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:55.273594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b34dc-39c0-48da-b0fd-ea65d4551992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:55.274252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b34dc-39c0-48da-b0fd-ea65d4551992 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:55.274527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b34dc-39c0-48da-b0fd-ea65d4551992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:55.274798 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b34dc-39c0-48da-b0fd-ea65d4551992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:55.275517 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b34dc-39c0-48da-b0fd-ea65d4551992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:55.278594 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b34dc-39c0-48da-b0fd-ea65d4551992 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:55.290147 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1420/2814] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:55.294625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b34dc-39c0-48da-b0fd-ea65d4551992 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:55.308323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b34dc-39c0-48da-b0fd-ea65d4551992 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:55.313767 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864828-3c40-401b-a813-94473d4616c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:55.314898 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864828-3c40-401b-a813-94473d4616c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:55.317125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864828-3c40-401b-a813-94473d4616c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:55.317565 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea864828-3c40-401b-a813-94473d4616c8 admin admin] PATH_INFO: `/v3/projects/62fb332f6d2b42d893790d530143827f/users/358bd282cc2e4e36819ce7c899f02999/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:55.341152 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea864828-3c40-401b-a813-94473d4616c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fb332f6d2b42d893790d530143827f, user_id=358bd282cc2e4e36819ce7c899f02999, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:55.344301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea864828-3c40-401b-a813-94473d4616c8 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:55.362087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa8ad8-04f7-4a23-9c84-8c52292a431c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:55.388369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d598478-6fed-4b64-b864-fdc835136793 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:55.390705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d598478-6fed-4b64-b864-fdc835136793 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:55.390705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d598478-6fed-4b64-b864-fdc835136793 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:55.390705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d598478-6fed-4b64-b864-fdc835136793 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:55.406410 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d598478-6fed-4b64-b864-fdc835136793 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:55.411487 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d598478-6fed-4b64-b864-fdc835136793 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:55.415324 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1421/2815] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:55 2022] PUT /identity/v3/projects/62fb332f6d2b42d893790d530143827f/users/358bd282cc2e4e36819ce7c899f02999/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:55.419850 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864828-3c40-401b-a813-94473d4616c8 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:55.451193 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1395/2816] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:17:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 20 22:17:55.538217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea864828-3c40-401b-a813-94473d4616c8 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:55.544826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42af520-388f-4a78-85c6-3833b921c3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:55.545357 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af520-388f-4a78-85c6-3833b921c3bd admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:55.545645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af520-388f-4a78-85c6-3833b921c3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:55.545925 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42af520-388f-4a78-85c6-3833b921c3bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:55.546831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42af520-388f-4a78-85c6-3833b921c3bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:55.548601 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42af520-388f-4a78-85c6-3833b921c3bd admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:55.563200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1422/2817] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:55.567179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d598478-6fed-4b64-b864-fdc835136793 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:55.579695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d598478-6fed-4b64-b864-fdc835136793 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:55.611399 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20c286-223b-4353-a374-47423612e220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:55.612418 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20c286-223b-4353-a374-47423612e220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:55.612707 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20c286-223b-4353-a374-47423612e220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:55.612986 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20c286-223b-4353-a374-47423612e220 admin admin] PATH_INFO: `/v3/projects/62fb332f6d2b42d893790d530143827f/users/358bd282cc2e4e36819ce7c899f02999/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:55.619349 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20c286-223b-4353-a374-47423612e220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fb332f6d2b42d893790d530143827f, user_id=358bd282cc2e4e36819ce7c899f02999, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:55.643616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20c286-223b-4353-a374-47423612e220 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:55.693314 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1396/2818] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:17:55 2022] PUT /identity/v3/projects/62fb332f6d2b42d893790d530143827f/users/358bd282cc2e4e36819ce7c899f02999/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:55.695287 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056445-b53c-44ad-b00a-1b11d171c103 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:55.695599 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056445-b53c-44ad-b00a-1b11d171c103 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:55.695890 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61056445-b53c-44ad-b00a-1b11d171c103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:55.759795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-61056445-b53c-44ad-b00a-1b11d171c103 None None] MFA Rules not processed for user `358bd282cc2e4e36819ce7c899f02999`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:55.762283 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-61056445-b53c-44ad-b00a-1b11d171c103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:55.894776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20c286-223b-4353-a374-47423612e220 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:55.897463 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6d20c286-223b-4353-a374-47423612e220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:55.971343 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1423/2819] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:55 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:55.981156 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61056445-b53c-44ad-b00a-1b11d171c103 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:55.983302 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-61056445-b53c-44ad-b00a-1b11d171c103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:56.068889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20c286-223b-4353-a374-47423612e220 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:56.084807 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:56.085813 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:56.086100 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:56.086460 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] PATH_INFO: `/v3/users/eb7ff6c95b9341fbaeb04ff13bbad0aa` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:56.088963 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7ff6c95b9341fbaeb04ff13bbad0aa)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:56.091889 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:56.153758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:56.166926 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61056445-b53c-44ad-b00a-1b11d171c103 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:56.179813 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b14bc-5e8b-4317-876b-d796edab688f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:56.183840 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b14bc-5e8b-4317-876b-d796edab688f service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:56.187361 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b14bc-5e8b-4317-876b-d796edab688f service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:56.187692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b14bc-5e8b-4317-876b-d796edab688f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:56.332005 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:56.344544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7ff6c95b9341fbaeb04ff13bbad0aa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:56.349905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b14bc-5e8b-4317-876b-d796edab688f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:56.351750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b14bc-5e8b-4317-876b-d796edab688f service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:56.366262 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7ff6c95b9341fbaeb04ff13bbad0aa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:56.379471 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7ff6c95b9341fbaeb04ff13bbad0aa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:56.380316 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7ff6c95b9341fbaeb04ff13bbad0aa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:56.381000 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7ff6c95b9341fbaeb04ff13bbad0aa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:56.394656 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1424/2820] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:17:56.463216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1397/2821] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:55 2022] DELETE /identity/v3/users/eb7ff6c95b9341fbaeb04ff13bbad0aa => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:56.469633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31c7f0-789a-4a81-b7ef-7a8cb1222ae1 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:56.470174 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31c7f0-789a-4a81-b7ef-7a8cb1222ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:56.470454 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31c7f0-789a-4a81-b7ef-7a8cb1222ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:56.514346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-da31c7f0-789a-4a81-b7ef-7a8cb1222ae1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:56.515751 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-da31c7f0-789a-4a81-b7ef-7a8cb1222ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:56.625994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1425/2822] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:56.635456 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:56.637768 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:56.757210 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b809f4b3-bdb2-4b22-a836-b2bab9c52a85 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:56.761837 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f8f9f-904f-4b59-81ed-a1471ff1e710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:56.762560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f8f9f-904f-4b59-81ed-a1471ff1e710 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:56.762911 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f8f9f-904f-4b59-81ed-a1471ff1e710 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:56.763261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f8f9f-904f-4b59-81ed-a1471ff1e710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:56.774238 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f8f9f-904f-4b59-81ed-a1471ff1e710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:56.779165 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f8f9f-904f-4b59-81ed-a1471ff1e710 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:56.788917 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1398/2823] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:57.582963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31c7f0-789a-4a81-b7ef-7a8cb1222ae1 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:57.584527 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-da31c7f0-789a-4a81-b7ef-7a8cb1222ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:57.604426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31c7f0-789a-4a81-b7ef-7a8cb1222ae1 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:57.617389 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:57.618308 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:57.618492 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:57.618770 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] PATH_INFO: `/v3/projects/0d7f6a68984942d487cb739ffe22ea90` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:57.624015 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d7f6a68984942d487cb739ffe22ea90)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:57.627323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:57.773953 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d7f6a68984942d487cb739ffe22ea90', 'request_id': 'req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:57.779468 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d7f6a68984942d487cb739ffe22ea90', 'request_id': 'req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:57.842845 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d7f6a68984942d487cb739ffe22ea90', 'request_id': 'req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:57.858213 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] The token cache is being invalidate because project 0d7f6a68984942d487cb739ffe22ea90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:57.858522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:57.859330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:57.861031 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1426/2824] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:57 2022] DELETE /identity/v3/projects/0d7f6a68984942d487cb739ffe22ea90 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:57.865205 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f8f9f-904f-4b59-81ed-a1471ff1e710 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:57.876633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f8f9f-904f-4b59-81ed-a1471ff1e710 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:57.950928 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:57.952035 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:57.952220 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:57.952523 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] PATH_INFO: `/v3/users/5691fe35190b4445b07a5056d589e758` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:57.953825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5691fe35190b4445b07a5056d589e758)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:57.955754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:58.167779 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5691fe35190b4445b07a5056d589e758'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:58.178596 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:58.185585 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5691fe35190b4445b07a5056d589e758'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:58.193977 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5691fe35190b4445b07a5056d589e758'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:58.195448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5691fe35190b4445b07a5056d589e758'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:58.195448 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5691fe35190b4445b07a5056d589e758'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:58.291568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1399/2825] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:17:57 2022] DELETE /identity/v3/users/5691fe35190b4445b07a5056d589e758 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:58.769782 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:58.772061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:58.812090 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:58.829250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:58.831175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:58.904085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fecb6-53a8-4b0e-836b-1b28bcb0142f admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:59.006397 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22028c-b861-4236-a144-318fa669454a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:59.007868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79a83fe-e818-4c6b-92e8-ae63242ad7da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:59.015026 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:59.015629 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a83fe-e818-4c6b-92e8-ae63242ad7da service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:59.016031 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a83fe-e818-4c6b-92e8-ae63242ad7da service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:59.016451 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79a83fe-e818-4c6b-92e8-ae63242ad7da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:59.016771 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:59.017132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:59.017482 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] PATH_INFO: `/v3/projects/853cbb44c4f24c8a8ca217787692c848` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:59.018907 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] RBAC: Authorizing `identity:delete_project(project_id=853cbb44c4f24c8a8ca217787692c848)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:59.019048 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d79a83fe-e818-4c6b-92e8-ae63242ad7da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:59.021207 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:59.103016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a83fe-e818-4c6b-92e8-ae63242ad7da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:59.104562 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79a83fe-e818-4c6b-92e8-ae63242ad7da service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:59.116436 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1427/2826] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:17:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:17:59.159859 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '853cbb44c4f24c8a8ca217787692c848', 'request_id': 'req-30700d3e-07ea-4904-bfbc-5f8f9663845b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:59.165554 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '853cbb44c4f24c8a8ca217787692c848', 'request_id': 'req-30700d3e-07ea-4904-bfbc-5f8f9663845b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:59.242518 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '853cbb44c4f24c8a8ca217787692c848', 'request_id': 'req-30700d3e-07ea-4904-bfbc-5f8f9663845b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:59.256290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] The token cache is being invalidate because project 853cbb44c4f24c8a8ca217787692c848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:17:59.256601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:59.257287 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-30700d3e-07ea-4904-bfbc-5f8f9663845b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:17:59.258956 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1400/2827] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:17:58 2022] DELETE /identity/v3/projects/853cbb44c4f24c8a8ca217787692c848 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:17:59.265193 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1acfc-4181-4995-b1fe-0dfbaa49de37 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:59.265483 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1acfc-4181-4995-b1fe-0dfbaa49de37 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:59.265763 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1acfc-4181-4995-b1fe-0dfbaa49de37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:59.286412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-91c1acfc-4181-4995-b1fe-0dfbaa49de37 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:59.287737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-91c1acfc-4181-4995-b1fe-0dfbaa49de37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:59.370007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1428/2828] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:59.378925 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11e305-9611-45dc-add9-361ccfb153e5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:59.379490 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11e305-9611-45dc-add9-361ccfb153e5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:59.379860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c11e305-9611-45dc-add9-361ccfb153e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:59.408560 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3c11e305-9611-45dc-add9-361ccfb153e5 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:17:59.409928 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3c11e305-9611-45dc-add9-361ccfb153e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:17:59.420528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1401/2829] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:17:59.424974 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1acfc-4181-4995-b1fe-0dfbaa49de37 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:59.437351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1acfc-4181-4995-b1fe-0dfbaa49de37 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:59.442281 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3ee65-a443-4b8a-93e4-5e346b008b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:59.443013 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3ee65-a443-4b8a-93e4-5e346b008b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:59.443390 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3ee65-a443-4b8a-93e4-5e346b008b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:59.443735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c3ee65-a443-4b8a-93e4-5e346b008b3d admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:59.444567 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3ee65-a443-4b8a-93e4-5e346b008b3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:17:59.444949 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3ee65-a443-4b8a-93e4-5e346b008b3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:59.446638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c3ee65-a443-4b8a-93e4-5e346b008b3d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:59.460939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1429/2830] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:17:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:17:59.466103 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11e305-9611-45dc-add9-361ccfb153e5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:59.476200 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c11e305-9611-45dc-add9-361ccfb153e5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:59.481836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8493a-de08-464a-b5a0-7441a6d7270d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:59.482491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8493a-de08-464a-b5a0-7441a6d7270d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:59.482776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8493a-de08-464a-b5a0-7441a6d7270d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:59.483047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8493a-de08-464a-b5a0-7441a6d7270d admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:59.483784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8493a-de08-464a-b5a0-7441a6d7270d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:59.485860 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8493a-de08-464a-b5a0-7441a6d7270d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:59.582602 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1402/2831] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:17:59 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:17:59.587333 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3ee65-a443-4b8a-93e4-5e346b008b3d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:59.599120 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c3ee65-a443-4b8a-93e4-5e346b008b3d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:59.620262 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:17:59.666994 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727e544-eddf-4b99-88e8-b1c39401f67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:59.668099 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727e544-eddf-4b99-88e8-b1c39401f67d admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:59.668397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727e544-eddf-4b99-88e8-b1c39401f67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:59.669123 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f727e544-eddf-4b99-88e8-b1c39401f67d admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:59.669644 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727e544-eddf-4b99-88e8-b1c39401f67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:59.671842 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f727e544-eddf-4b99-88e8-b1c39401f67d admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:59.936387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1430/2832] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:17:59 2022] POST /identity/v3/users => generated 286 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 20 22:17:59.938506 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8493a-de08-464a-b5a0-7441a6d7270d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:59.957603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8493a-de08-464a-b5a0-7441a6d7270d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:17:59.963159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589df4-308f-4d98-8fc2-9bbb28b5621b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:17:59.963974 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589df4-308f-4d98-8fc2-9bbb28b5621b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:17:59.964386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589df4-308f-4d98-8fc2-9bbb28b5621b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:17:59.966914 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4589df4-308f-4d98-8fc2-9bbb28b5621b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:17:59.967725 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4589df4-308f-4d98-8fc2-9bbb28b5621b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:17:59.969417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4589df4-308f-4d98-8fc2-9bbb28b5621b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:17:59.987855 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727e544-eddf-4b99-88e8-b1c39401f67d admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:17:59.993534 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1403/2833] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:17:59.999948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f727e544-eddf-4b99-88e8-b1c39401f67d admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:00.005040 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429fab4-04bc-4904-bf67-f8b8579739ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:00.005710 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429fab4-04bc-4904-bf67-f8b8579739ee admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:00.005993 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429fab4-04bc-4904-bf67-f8b8579739ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:00.006410 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429fab4-04bc-4904-bf67-f8b8579739ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:00.007149 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429fab4-04bc-4904-bf67-f8b8579739ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:00.008773 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429fab4-04bc-4904-bf67-f8b8579739ee admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:00.026798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589df4-308f-4d98-8fc2-9bbb28b5621b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:00.031815 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1431/2834] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:17:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 20 22:18:00.037939 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4589df4-308f-4d98-8fc2-9bbb28b5621b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:00.045896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2abe2-aab5-4a09-97b0-bee06ab2d200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:00.045896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2abe2-aab5-4a09-97b0-bee06ab2d200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:00.045896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2abe2-aab5-4a09-97b0-bee06ab2d200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:00.045896 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2abe2-aab5-4a09-97b0-bee06ab2d200 admin admin] PATH_INFO: `/v3/projects/7ba6ca552ce04e43bc79902db620dd8c/users/5536e230d2d2409ba87100b84b76c360/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:00.072392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2abe2-aab5-4a09-97b0-bee06ab2d200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba6ca552ce04e43bc79902db620dd8c, user_id=5536e230d2d2409ba87100b84b76c360, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:00.084798 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b2abe2-aab5-4a09-97b0-bee06ab2d200 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:00.173804 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1404/2835] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:18:00 2022] PUT /identity/v3/projects/7ba6ca552ce04e43bc79902db620dd8c/users/5536e230d2d2409ba87100b84b76c360/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:00.175244 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e52159-b509-4344-acb6-bad049d6f80a None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:00.175628 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e52159-b509-4344-acb6-bad049d6f80a None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:00.176005 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e52159-b509-4344-acb6-bad049d6f80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:00.197195 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-50e52159-b509-4344-acb6-bad049d6f80a None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:18:00.198575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-50e52159-b509-4344-acb6-bad049d6f80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:00.267204 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1432/2836] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 20 22:18:00.277850 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2abe2-aab5-4a09-97b0-bee06ab2d200 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:00.285739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f6b2abe2-aab5-4a09-97b0-bee06ab2d200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:00.286202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:00.361934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2abe2-aab5-4a09-97b0-bee06ab2d200 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:00.366008 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2b561a-404c-44a4-bf85-baf5abc1e8dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:00.366790 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b561a-404c-44a4-bf85-baf5abc1e8dc service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:00.367076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b561a-404c-44a4-bf85-baf5abc1e8dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:00.367358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2b561a-404c-44a4-bf85-baf5abc1e8dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:00.378330 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b561a-404c-44a4-bf85-baf5abc1e8dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:00.379845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2b561a-404c-44a4-bf85-baf5abc1e8dc service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:00.390763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1405/2837] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:18:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:18:00.886036 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e52159-b509-4344-acb6-bad049d6f80a None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:00.888255 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-50e52159-b509-4344-acb6-bad049d6f80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:00.953587 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e52159-b509-4344-acb6-bad049d6f80a None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:00.957546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b089681-4665-4412-acb7-ad4f706dfce2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:00.958203 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b089681-4665-4412-acb7-ad4f706dfce2 service cinder] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:00.963690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b089681-4665-4412-acb7-ad4f706dfce2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:00.963690 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b089681-4665-4412-acb7-ad4f706dfce2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:00.968868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-8b089681-4665-4412-acb7-ad4f706dfce2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:01.057091 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:01.069349 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b089681-4665-4412-acb7-ad4f706dfce2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:01.071250 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b089681-4665-4412-acb7-ad4f706dfce2 service cinder] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:01.086031 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1433/2838] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:18:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:18:03.193030 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e47e-c6ff-4e83-838c-68a9b4a2bd81 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:03.196874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e47e-c6ff-4e83-838c-68a9b4a2bd81 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:03.196874 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d7e47e-c6ff-4e83-838c-68a9b4a2bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:03.238883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-80d7e47e-c6ff-4e83-838c-68a9b4a2bd81 None None] MFA Rules not processed for user `5536e230d2d2409ba87100b84b76c360`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:18:03.241636 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-80d7e47e-c6ff-4e83-838c-68a9b4a2bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:03.339013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1406/2839] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:18:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:18:03.344899 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b089681-4665-4412-acb7-ad4f706dfce2 service cinder] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:03.370320 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b089681-4665-4412-acb7-ad4f706dfce2 service cinder] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:03.376426 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d1d0a-bd40-46a6-a7bc-a4c7b7f614e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:03.377176 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d1d0a-bd40-46a6-a7bc-a4c7b7f614e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:03.377456 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d1d0a-bd40-46a6-a7bc-a4c7b7f614e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:03.377795 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9d1d0a-bd40-46a6-a7bc-a4c7b7f614e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:03.378546 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d1d0a-bd40-46a6-a7bc-a4c7b7f614e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:03.380645 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9d1d0a-bd40-46a6-a7bc-a4c7b7f614e7 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:03.492431 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1434/2840] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:18:03 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:18:03.495929 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7e47e-c6ff-4e83-838c-68a9b4a2bd81 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:03.515512 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d7e47e-c6ff-4e83-838c-68a9b4a2bd81 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:03.587581 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a484-41b4-437f-af3a-ab3cdcabfb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:03.588285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a484-41b4-437f-af3a-ab3cdcabfb63 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:03.588568 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a484-41b4-437f-af3a-ab3cdcabfb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:03.588845 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14a484-41b4-437f-af3a-ab3cdcabfb63 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:03.589544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14a484-41b4-437f-af3a-ab3cdcabfb63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:03.592546 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14a484-41b4-437f-af3a-ab3cdcabfb63 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:03.764763 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1407/2841] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:18:03 2022] POST /identity/v3/users => generated 293 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:18:03.765105 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d1d0a-bd40-46a6-a7bc-a4c7b7f614e7 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:03.782511 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9d1d0a-bd40-46a6-a7bc-a4c7b7f614e7 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:03.798387 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7687-8854-47d4-9498-79deeb860a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:03.799796 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7687-8854-47d4-9498-79deeb860a90 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:03.800963 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7687-8854-47d4-9498-79deeb860a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:03.801261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7687-8854-47d4-9498-79deeb860a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:03.803347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f7687-8854-47d4-9498-79deeb860a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:03.807872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3f7687-8854-47d4-9498-79deeb860a90 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:03.828611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1435/2842] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:18:03.833416 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a484-41b4-437f-af3a-ab3cdcabfb63 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:03.846290 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14a484-41b4-437f-af3a-ab3cdcabfb63 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:03.849306 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67516528-9653-4e55-b0b6-b69f35cdfed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:03.850342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67516528-9653-4e55-b0b6-b69f35cdfed8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:03.850622 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67516528-9653-4e55-b0b6-b69f35cdfed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:03.850900 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67516528-9653-4e55-b0b6-b69f35cdfed8 admin admin] PATH_INFO: `/v3/projects/260577fc3b5d4241b9e7ea56b63591cb/users/1da29d15fa8f4e3f8d3785f41daa2033/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:03.868517 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67516528-9653-4e55-b0b6-b69f35cdfed8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260577fc3b5d4241b9e7ea56b63591cb, user_id=1da29d15fa8f4e3f8d3785f41daa2033, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:03.871695 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67516528-9653-4e55-b0b6-b69f35cdfed8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:03.984677 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:03.990740 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1408/2843] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:18:03 2022] PUT /identity/v3/projects/260577fc3b5d4241b9e7ea56b63591cb/users/1da29d15fa8f4e3f8d3785f41daa2033/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:03.994682 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7687-8854-47d4-9498-79deeb860a90 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:04.007158 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7687-8854-47d4-9498-79deeb860a90 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:04.067638 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3f4a3-d427-4de2-b4e0-65618000aa8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:04.068439 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f4a3-d427-4de2-b4e0-65618000aa8f admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:04.068724 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f4a3-d427-4de2-b4e0-65618000aa8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:04.069025 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3f4a3-d427-4de2-b4e0-65618000aa8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:04.069801 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3f4a3-d427-4de2-b4e0-65618000aa8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:04.071384 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3f4a3-d427-4de2-b4e0-65618000aa8f admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:04.083126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1436/2844] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:18:03 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:18:04.088979 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67516528-9653-4e55-b0b6-b69f35cdfed8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:04.098742 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67516528-9653-4e55-b0b6-b69f35cdfed8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:04.103626 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55200601-7eb8-497d-9013-30b979148c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:04.104542 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55200601-7eb8-497d-9013-30b979148c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:04.104825 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55200601-7eb8-497d-9013-30b979148c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:04.105099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55200601-7eb8-497d-9013-30b979148c5f admin admin] PATH_INFO: `/v3/projects/260577fc3b5d4241b9e7ea56b63591cb/users/1da29d15fa8f4e3f8d3785f41daa2033/roles/01b5cc9fdaf942efb958189754cd6a9e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:04.107785 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55200601-7eb8-497d-9013-30b979148c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=260577fc3b5d4241b9e7ea56b63591cb, user_id=1da29d15fa8f4e3f8d3785f41daa2033, role_id=01b5cc9fdaf942efb958189754cd6a9e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:04.110505 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55200601-7eb8-497d-9013-30b979148c5f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:04.149247 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1409/2845] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:18:04 2022] PUT /identity/v3/projects/260577fc3b5d4241b9e7ea56b63591cb/users/1da29d15fa8f4e3f8d3785f41daa2033/roles/01b5cc9fdaf942efb958189754cd6a9e => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:05.512401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88dbc8-923b-4c37-87c1-89ed68cf088f None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:05.512401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88dbc8-923b-4c37-87c1-89ed68cf088f None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:05.513548 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88dbc8-923b-4c37-87c1-89ed68cf088f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:05.541334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-5b88dbc8-923b-4c37-87c1-89ed68cf088f None None] MFA Rules not processed for user `1da29d15fa8f4e3f8d3785f41daa2033`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:18:05.542844 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5b88dbc8-923b-4c37-87c1-89ed68cf088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:05.626201 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1437/2846] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:18:05.639172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8025e-9612-4e61-b24e-4cf5af658a1c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:05.639703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8025e-9612-4e61-b24e-4cf5af658a1c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:05.639703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8025e-9612-4e61-b24e-4cf5af658a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:05.662666 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f3e8025e-9612-4e61-b24e-4cf5af658a1c None None] MFA Rules not processed for user `5536e230d2d2409ba87100b84b76c360`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:18:05.664182 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f3e8025e-9612-4e61-b24e-4cf5af658a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:05.723256 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1410/2847] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:18:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:18:05.734519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88dbc8-923b-4c37-87c1-89ed68cf088f None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:05.735962 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5b88dbc8-923b-4c37-87c1-89ed68cf088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:05.779941 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:05.809824 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88dbc8-923b-4c37-87c1-89ed68cf088f None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:05.815742 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c22d9-984c-4325-9804-1f1952bf107d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:05.816418 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c22d9-984c-4325-9804-1f1952bf107d service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:05.816726 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c22d9-984c-4325-9804-1f1952bf107d service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:05.817007 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c22d9-984c-4325-9804-1f1952bf107d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:05.825485 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c22d9-984c-4325-9804-1f1952bf107d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:05.827082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c22d9-984c-4325-9804-1f1952bf107d service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:05.836254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1438/2848] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:18:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:18:06.073965 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8025e-9612-4e61-b24e-4cf5af658a1c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:06.135013 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8025e-9612-4e61-b24e-4cf5af658a1c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:06.139633 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630f915-ee9b-4dda-beb1-7db0ac956f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:06.140329 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f915-ee9b-4dda-beb1-7db0ac956f37 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:06.140612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f915-ee9b-4dda-beb1-7db0ac956f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:06.140890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630f915-ee9b-4dda-beb1-7db0ac956f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:06.142746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2630f915-ee9b-4dda-beb1-7db0ac956f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:06.152836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f915-ee9b-4dda-beb1-7db0ac956f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:06.154285 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630f915-ee9b-4dda-beb1-7db0ac956f37 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:06.162846 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1411/2849] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:18:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:18:06.977913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c22d9-984c-4325-9804-1f1952bf107d service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:06.979337 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-eb3c22d9-984c-4325-9804-1f1952bf107d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:07.054053 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c22d9-984c-4325-9804-1f1952bf107d service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:07.058604 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:07.060256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:07.060256 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:07.065914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] PATH_INFO: `/v3/users/eb42bdf3d08b4282bbde04aa017667e2` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:07.065914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb42bdf3d08b4282bbde04aa017667e2)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:07.065914 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:07.287701 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb42bdf3d08b4282bbde04aa017667e2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:07.391178 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb42bdf3d08b4282bbde04aa017667e2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:07.398998 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb42bdf3d08b4282bbde04aa017667e2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:07.399633 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb42bdf3d08b4282bbde04aa017667e2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:07.412734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb42bdf3d08b4282bbde04aa017667e2'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:07.418882 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1439/2850] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:18:06 2022] DELETE /identity/v3/users/eb42bdf3d08b4282bbde04aa017667e2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:07.424867 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21743d7-b32c-4946-af90-930834edf504 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:07.425395 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21743d7-b32c-4946-af90-930834edf504 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:07.425631 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21743d7-b32c-4946-af90-930834edf504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:07.444202 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c21743d7-b32c-4946-af90-930834edf504 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:18:07.445468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c21743d7-b32c-4946-af90-930834edf504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:07.514776 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1412/2851] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:18:07.525603 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:07.526996 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:07.580879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:07.593001 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b558a4c-49f6-440e-90eb-43e97eb860f5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:07.601807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba8d60-6765-4a6e-89a3-e543882bd79a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:07.601807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba8d60-6765-4a6e-89a3-e543882bd79a service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:07.601807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba8d60-6765-4a6e-89a3-e543882bd79a service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:07.601807 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba8d60-6765-4a6e-89a3-e543882bd79a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:07.609251 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba8d60-6765-4a6e-89a3-e543882bd79a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:07.610734 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba8d60-6765-4a6e-89a3-e543882bd79a service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:07.621185 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1440/2852] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:18:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:18:08.067797 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21743d7-b32c-4946-af90-930834edf504 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:08.069462 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c21743d7-b32c-4946-af90-930834edf504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:08.082967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21743d7-b32c-4946-af90-930834edf504 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:08.087958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:08.089226 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:08.089645 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:08.089774 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] PATH_INFO: `/v3/projects/581bb2a5378844118c40e42f65804f8a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:08.090969 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581bb2a5378844118c40e42f65804f8a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:08.093712 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:08.223307 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:08.238577 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581bb2a5378844118c40e42f65804f8a', 'request_id': 'req-c71b304a-57a6-4a40-845b-105d0940fd08'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:08.244053 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581bb2a5378844118c40e42f65804f8a', 'request_id': 'req-c71b304a-57a6-4a40-845b-105d0940fd08'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:08.354085 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581bb2a5378844118c40e42f65804f8a', 'request_id': 'req-c71b304a-57a6-4a40-845b-105d0940fd08'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:08.368270 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] The token cache is being invalidate because project 581bb2a5378844118c40e42f65804f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:18:08.368562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:08.369223 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:08.370971 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1413/2853] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:18:08 2022] DELETE /identity/v3/projects/581bb2a5378844118c40e42f65804f8a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:08.376296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba8d60-6765-4a6e-89a3-e543882bd79a service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:08.390381 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba8d60-6765-4a6e-89a3-e543882bd79a service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:08.459296 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:08.460316 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:08.460608 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:08.460884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] PATH_INFO: `/v3/users/0e0dd4890dac40518490a1d29581cd10` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:08.462082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0dd4890dac40518490a1d29581cd10)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:08.464012 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:08.704692 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0dd4890dac40518490a1d29581cd10'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:08.788669 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0dd4890dac40518490a1d29581cd10'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:08.798830 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0dd4890dac40518490a1d29581cd10'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:08.800756 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0dd4890dac40518490a1d29581cd10'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:08.818340 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0dd4890dac40518490a1d29581cd10'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:08.825325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1441/2854] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:18:08 2022] DELETE /identity/v3/users/0e0dd4890dac40518490a1d29581cd10 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:09.411087 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:09.412557 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:09.426569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b304a-57a6-4a40-845b-105d0940fd08 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:09.485396 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:09.486261 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:09.486569 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:09.486826 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] PATH_INFO: `/v3/projects/7a71939fc6cd48f398b02cc98af463b5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:09.488059 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a71939fc6cd48f398b02cc98af463b5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:09.489984 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:09.614499 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a71939fc6cd48f398b02cc98af463b5', 'request_id': 'req-eda9cd38-6e1e-456f-b629-106d355bf4f9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:09.621653 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a71939fc6cd48f398b02cc98af463b5', 'request_id': 'req-eda9cd38-6e1e-456f-b629-106d355bf4f9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:09.719681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a71939fc6cd48f398b02cc98af463b5', 'request_id': 'req-eda9cd38-6e1e-456f-b629-106d355bf4f9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:09.732336 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] The token cache is being invalidate because project 7a71939fc6cd48f398b02cc98af463b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:18:09.732559 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:09.733384 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:09.735363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1414/2855] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:18:09 2022] DELETE /identity/v3/projects/7a71939fc6cd48f398b02cc98af463b5 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:18:09.740167 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:09.742217 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:09.767423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fe208-efa9-4ed3-a83a-89fe3bd5ebcb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:09.841538 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:09.842467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:09.842831 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:09.843113 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] PATH_INFO: `/v3/users/358bd282cc2e4e36819ce7c899f02999` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:09.844553 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=358bd282cc2e4e36819ce7c899f02999)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:09.846482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:09.853619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:10.060173 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '358bd282cc2e4e36819ce7c899f02999'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:10.194220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '358bd282cc2e4e36819ce7c899f02999'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:10.202020 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '358bd282cc2e4e36819ce7c899f02999'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:10.202746 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '358bd282cc2e4e36819ce7c899f02999'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:10.215836 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '358bd282cc2e4e36819ce7c899f02999'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:10.225843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1442/2856] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:18:09 2022] DELETE /identity/v3/users/358bd282cc2e4e36819ce7c899f02999 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:18:10.696192 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:10.698883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:10.716727 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9cd38-6e1e-456f-b629-106d355bf4f9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:10.775648 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:10.793389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:10.793389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:10.793389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:10.793389 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] PATH_INFO: `/v3/projects/62fb332f6d2b42d893790d530143827f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:10.890174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] RBAC: Authorizing `identity:delete_project(project_id=62fb332f6d2b42d893790d530143827f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:10.890174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:11.032383 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62fb332f6d2b42d893790d530143827f', 'request_id': 'req-2c99ab65-4b0b-462d-b3ac-39625e46436f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:11.038345 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62fb332f6d2b42d893790d530143827f', 'request_id': 'req-2c99ab65-4b0b-462d-b3ac-39625e46436f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:11.125286 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62fb332f6d2b42d893790d530143827f', 'request_id': 'req-2c99ab65-4b0b-462d-b3ac-39625e46436f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:11.137934 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] The token cache is being invalidate because project 62fb332f6d2b42d893790d530143827f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:18:11.138281 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:11.138987 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:11.140729 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1415/2857] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:18:10 2022] DELETE /identity/v3/projects/62fb332f6d2b42d893790d530143827f => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:17.597404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:17.598883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:17.656920 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ae3ce-764e-4f20-b304-22fedcbac512 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:17.704939 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ce20-4228-46e3-8e67-b7c51f801635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:17.705502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ce20-4228-46e3-8e67-b7c51f801635 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:17.705778 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ce20-4228-46e3-8e67-b7c51f801635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:17.706049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c5ce20-4228-46e3-8e67-b7c51f801635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:17.707804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-62c5ce20-4228-46e3-8e67-b7c51f801635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:17.758723 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:17.769895 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5ce20-4228-46e3-8e67-b7c51f801635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:17.771314 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c5ce20-4228-46e3-8e67-b7c51f801635 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:17.780761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1443/2858] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:18:17 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:18:21.588114 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=29,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:22.453064 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:22.454654 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:22.514393 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99ab65-4b0b-462d-b3ac-39625e46436f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:22.518158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594cd1d-53a7-48a4-a2a0-d25cfebebb1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:22.518830 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594cd1d-53a7-48a4-a2a0-d25cfebebb1b service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:22.519099 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594cd1d-53a7-48a4-a2a0-d25cfebebb1b service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:22.519376 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9594cd1d-53a7-48a4-a2a0-d25cfebebb1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:22.521190 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9594cd1d-53a7-48a4-a2a0-d25cfebebb1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:22.588749 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594cd1d-53a7-48a4-a2a0-d25cfebebb1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:22.590295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9594cd1d-53a7-48a4-a2a0-d25cfebebb1b service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:22.600649 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1416/2859] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:18:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:18:28.144764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:32.596507 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=50 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:47.629112 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ce20-4228-46e3-8e67-b7c51f801635 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:47.630635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-62c5ce20-4228-46e3-8e67-b7c51f801635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:47.699648 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c5ce20-4228-46e3-8e67-b7c51f801635 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:47.704277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:47.705146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:47.705429 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:47.705702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] PATH_INFO: `/v3/users/5536e230d2d2409ba87100b84b76c360` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:47.706935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5536e230d2d2409ba87100b84b76c360)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:47.708929 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:47.919764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5536e230d2d2409ba87100b84b76c360'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.002079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5536e230d2d2409ba87100b84b76c360'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.010056 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5536e230d2d2409ba87100b84b76c360'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.010697 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5536e230d2d2409ba87100b84b76c360'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.023232 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5536e230d2d2409ba87100b84b76c360'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.029334 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1444/2860] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:18:47 2022] DELETE /identity/v3/users/5536e230d2d2409ba87100b84b76c360 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:18:48.326112 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594cd1d-53a7-48a4-a2a0-d25cfebebb1b service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:48.340041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9594cd1d-53a7-48a4-a2a0-d25cfebebb1b service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:48.402503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:48.403368 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:48.403652 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:48.403939 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] PATH_INFO: `/v3/projects/7ba6ca552ce04e43bc79902db620dd8c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:48.405168 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba6ca552ce04e43bc79902db620dd8c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:48.407116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:48.521333 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba6ca552ce04e43bc79902db620dd8c', 'request_id': 'req-d1f946d7-4677-451b-a74e-6c0788b8a75a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.526992 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba6ca552ce04e43bc79902db620dd8c', 'request_id': 'req-d1f946d7-4677-451b-a74e-6c0788b8a75a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.595940 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba6ca552ce04e43bc79902db620dd8c', 'request_id': 'req-d1f946d7-4677-451b-a74e-6c0788b8a75a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.608805 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] The token cache is being invalidate because project 7ba6ca552ce04e43bc79902db620dd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:18:48.613179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.613179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.613179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1417/2861] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:18:48 2022] DELETE /identity/v3/projects/7ba6ca552ce04e43bc79902db620dd8c => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:48.615444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:48.617634 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:48.630917 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7ccd0-c9c6-4313-b20a-0e6cb0d10966 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:48.689875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:48.690744 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:48.691019 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:48.691289 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] PATH_INFO: `/v3/users/1da29d15fa8f4e3f8d3785f41daa2033` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:48.692501 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da29d15fa8f4e3f8d3785f41daa2033)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:48.694392 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:48.715619 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:48.892106 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da29d15fa8f4e3f8d3785f41daa2033'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.952574 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da29d15fa8f4e3f8d3785f41daa2033'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.961125 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da29d15fa8f4e3f8d3785f41daa2033'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.961834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da29d15fa8f4e3f8d3785f41daa2033'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.974225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-ed887214-7034-42c7-a893-b638e9e8a871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da29d15fa8f4e3f8d3785f41daa2033'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:48.981047 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1445/2862] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:18:48 2022] DELETE /identity/v3/users/1da29d15fa8f4e3f8d3785f41daa2033 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:49.249136 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:49.250920 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:49.265417 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f946d7-4677-451b-a74e-6c0788b8a75a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:49.344612 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:49.345478 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:49.345762 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:49.346041 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] PATH_INFO: `/v3/projects/260577fc3b5d4241b9e7ea56b63591cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:49.347222 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=260577fc3b5d4241b9e7ea56b63591cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:49.349291 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:49.455094 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:49.472012 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260577fc3b5d4241b9e7ea56b63591cb', 'request_id': 'req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:49.475334 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260577fc3b5d4241b9e7ea56b63591cb', 'request_id': 'req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:49.541533 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260577fc3b5d4241b9e7ea56b63591cb', 'request_id': 'req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:49.556705 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] The token cache is being invalidate because project 260577fc3b5d4241b9e7ea56b63591cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:18:49.556999 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:49.557669 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9bafc4c5-4e75-4cfe-801b-45ffcfd67054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:18:49.559413 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1418/2863] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:18:49 2022] DELETE /identity/v3/projects/260577fc3b5d4241b9e7ea56b63591cb => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:49.565122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af2de5-10da-40ce-ac04-ca417d7d5298 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:49.565412 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af2de5-10da-40ce-ac04-ca417d7d5298 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:49.565693 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63af2de5-10da-40ce-ac04-ca417d7d5298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:49.587029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-63af2de5-10da-40ce-ac04-ca417d7d5298 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:18:49.588549 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-63af2de5-10da-40ce-ac04-ca417d7d5298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:49.670650 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1446/2864] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:18:49.678749 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d85fa-7844-4164-a232-2b33bb0473f1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:49.679870 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d85fa-7844-4164-a232-2b33bb0473f1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:49.680216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d85fa-7844-4164-a232-2b33bb0473f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:49.699957 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4e7d85fa-7844-4164-a232-2b33bb0473f1 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:18:49.701616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e7d85fa-7844-4164-a232-2b33bb0473f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:49.712526 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1419/2865] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:18:49.715477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af2de5-10da-40ce-ac04-ca417d7d5298 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:49.726697 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63af2de5-10da-40ce-ac04-ca417d7d5298 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:49.731299 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b5d73-8c33-4807-a9c5-3a072f89749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:49.731980 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b5d73-8c33-4807-a9c5-3a072f89749c admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:49.732257 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b5d73-8c33-4807-a9c5-3a072f89749c admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:49.732522 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4b5d73-8c33-4807-a9c5-3a072f89749c admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:49.733246 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b5d73-8c33-4807-a9c5-3a072f89749c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:18:49.733547 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b5d73-8c33-4807-a9c5-3a072f89749c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:49.735118 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4b5d73-8c33-4807-a9c5-3a072f89749c admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:49.747715 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1447/2866] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 20 22:18:49.751691 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d85fa-7844-4164-a232-2b33bb0473f1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:49.762159 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d85fa-7844-4164-a232-2b33bb0473f1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:49.766935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb536c-d59e-464f-9b41-672e8dd03696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:49.767619 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb536c-d59e-464f-9b41-672e8dd03696 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:49.767903 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb536c-d59e-464f-9b41-672e8dd03696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:49.768209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb536c-d59e-464f-9b41-672e8dd03696 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:49.768897 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb536c-d59e-464f-9b41-672e8dd03696 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:49.770842 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb536c-d59e-464f-9b41-672e8dd03696 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:49.898480 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1420/2867] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:18:49 2022] POST /identity/v3/projects => generated 365 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:18:49.902741 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b5d73-8c33-4807-a9c5-3a072f89749c admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:49.912631 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4b5d73-8c33-4807-a9c5-3a072f89749c admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:49.971140 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551961c-e45a-4afa-a2c1-98c4dcfb4ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:49.971809 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551961c-e45a-4afa-a2c1-98c4dcfb4ebb admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:49.972131 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551961c-e45a-4afa-a2c1-98c4dcfb4ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:49.972407 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551961c-e45a-4afa-a2c1-98c4dcfb4ebb admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:49.973100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551961c-e45a-4afa-a2c1-98c4dcfb4ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:49.975049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551961c-e45a-4afa-a2c1-98c4dcfb4ebb admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:50.077826 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1448/2868] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:18:49 2022] POST /identity/v3/users => generated 283 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:18:50.079363 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb536c-d59e-464f-9b41-672e8dd03696 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:50.091091 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb536c-d59e-464f-9b41-672e8dd03696 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:50.095778 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cfbc7-0a92-41a2-9b3c-2e0c4d57cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:50.096557 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cfbc7-0a92-41a2-9b3c-2e0c4d57cb4e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:50.096852 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cfbc7-0a92-41a2-9b3c-2e0c4d57cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:50.097213 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cfbc7-0a92-41a2-9b3c-2e0c4d57cb4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:50.098084 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cfbc7-0a92-41a2-9b3c-2e0c4d57cb4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:50.100236 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cfbc7-0a92-41a2-9b3c-2e0c4d57cb4e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:50.112093 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1421/2869] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:18:50.115861 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551961c-e45a-4afa-a2c1-98c4dcfb4ebb admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:50.126205 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551961c-e45a-4afa-a2c1-98c4dcfb4ebb admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:50.130750 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5607789b-cb76-4195-8fad-6a61bcd9aef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:50.131495 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607789b-cb76-4195-8fad-6a61bcd9aef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:50.131702 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607789b-cb76-4195-8fad-6a61bcd9aef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:50.132502 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5607789b-cb76-4195-8fad-6a61bcd9aef2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:50.133556 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607789b-cb76-4195-8fad-6a61bcd9aef2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:50.135143 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5607789b-cb76-4195-8fad-6a61bcd9aef2 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:50.145382 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1449/2870] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:18:50.150361 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cfbc7-0a92-41a2-9b3c-2e0c4d57cb4e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:50.160536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cfbc7-0a92-41a2-9b3c-2e0c4d57cb4e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:50.165295 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efb1df-4b0c-4514-bb3a-fdd1b17739d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:50.166209 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efb1df-4b0c-4514-bb3a-fdd1b17739d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:50.166494 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efb1df-4b0c-4514-bb3a-fdd1b17739d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:50.166772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2efb1df-4b0c-4514-bb3a-fdd1b17739d3 admin admin] PATH_INFO: `/v3/projects/03cce563366b49b48424398cf32892d2/users/09e83407240b490d9fa3a82534d90bee/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:50.182179 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efb1df-4b0c-4514-bb3a-fdd1b17739d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cce563366b49b48424398cf32892d2, user_id=09e83407240b490d9fa3a82534d90bee, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:50.184927 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2efb1df-4b0c-4514-bb3a-fdd1b17739d3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:50.305611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1422/2871] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:18:50 2022] PUT /identity/v3/projects/03cce563366b49b48424398cf32892d2/users/09e83407240b490d9fa3a82534d90bee/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:18:50.317250 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b348c-cb74-401c-b1fc-a5d23c7b5c14 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:50.317545 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b348c-cb74-401c-b1fc-a5d23c7b5c14 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:50.317822 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b348c-cb74-401c-b1fc-a5d23c7b5c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:50.327935 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:18:50.349028 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-d86b348c-cb74-401c-b1fc-a5d23c7b5c14 None None] MFA Rules not processed for user `09e83407240b490d9fa3a82534d90bee`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:18:50.350365 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-d86b348c-cb74-401c-b1fc-a5d23c7b5c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:50.415225 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1450/2872] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:18:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:18:50.427067 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efb1df-4b0c-4514-bb3a-fdd1b17739d3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:18:50.428155 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f2efb1df-4b0c-4514-bb3a-fdd1b17739d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:18:50.489110 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2efb1df-4b0c-4514-bb3a-fdd1b17739d3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:18:50.493476 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5072a6-6acd-4aaa-89e6-2485418da442 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:18:50.494174 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5072a6-6acd-4aaa-89e6-2485418da442 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:18:50.494465 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5072a6-6acd-4aaa-89e6-2485418da442 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:18:50.494746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5072a6-6acd-4aaa-89e6-2485418da442 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:18:50.503472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5072a6-6acd-4aaa-89e6-2485418da442 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:18:50.506228 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5072a6-6acd-4aaa-89e6-2485418da442 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:18:50.514603 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1423/2873] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:18:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:19:00.510503 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=65,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:19:00.598301 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=30 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:19:23.888126 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b348c-cb74-401c-b1fc-a5d23c7b5c14 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:23.952325 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b348c-cb74-401c-b1fc-a5d23c7b5c14 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:23.956827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:23.957768 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:23.958049 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:23.958323 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] PATH_INFO: `/v3/users/09e83407240b490d9fa3a82534d90bee` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:23.959591 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e83407240b490d9fa3a82534d90bee)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:23.961640 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:24.164327 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e83407240b490d9fa3a82534d90bee'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:24.235411 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e83407240b490d9fa3a82534d90bee'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:24.243044 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e83407240b490d9fa3a82534d90bee'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:24.243697 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e83407240b490d9fa3a82534d90bee'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:24.257002 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e83407240b490d9fa3a82534d90bee'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:24.263913 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1451/2874] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:19:23 2022] DELETE /identity/v3/users/09e83407240b490d9fa3a82534d90bee => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:19:24.268574 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa47c-76ac-41be-9a4e-43811e4572c2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:24.269124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa47c-76ac-41be-9a4e-43811e4572c2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:24.269124 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eaa47c-76ac-41be-9a4e-43811e4572c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:24.285890 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-48eaa47c-76ac-41be-9a4e-43811e4572c2 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:19:24.287120 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-48eaa47c-76ac-41be-9a4e-43811e4572c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:24.348019 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1424/2875] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:19:24.357955 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:24.359350 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:24.419220 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c2d41-71ef-4c39-8c31-28ef7aaa2805 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:24.422696 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be58144-d198-4d94-a99c-f0a926ef8a2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:24.423330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be58144-d198-4d94-a99c-f0a926ef8a2d service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:24.423605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be58144-d198-4d94-a99c-f0a926ef8a2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:24.423872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be58144-d198-4d94-a99c-f0a926ef8a2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:24.433620 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be58144-d198-4d94-a99c-f0a926ef8a2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:24.436232 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be58144-d198-4d94-a99c-f0a926ef8a2d service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:24.445295 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1452/2876] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:19:24.845702 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaa47c-76ac-41be-9a4e-43811e4572c2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:24.847150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-48eaa47c-76ac-41be-9a4e-43811e4572c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:24.861792 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eaa47c-76ac-41be-9a4e-43811e4572c2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:24.866640 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:24.867500 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:24.867784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:24.868095 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] PATH_INFO: `/v3/projects/03cce563366b49b48424398cf32892d2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:24.870137 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cce563366b49b48424398cf32892d2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:24.873537 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:24.988386 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cce563366b49b48424398cf32892d2', 'request_id': 'req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:24.993806 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cce563366b49b48424398cf32892d2', 'request_id': 'req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:25.044888 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cce563366b49b48424398cf32892d2', 'request_id': 'req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:25.056175 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] The token cache is being invalidate because project 03cce563366b49b48424398cf32892d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:19:25.061608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:25.061608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-46deb4d3-8f36-44c1-9357-3ae739ad3ba6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:25.061608 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1425/2877] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:19:24 2022] DELETE /identity/v3/projects/03cce563366b49b48424398cf32892d2 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:19:25.064868 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b3ba-adcf-4373-a3d6-3f284eaacab9 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:25.065359 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b3ba-adcf-4373-a3d6-3f284eaacab9 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:25.065471 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d72b3ba-adcf-4373-a3d6-3f284eaacab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:25.083186 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-6d72b3ba-adcf-4373-a3d6-3f284eaacab9 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:19:25.084554 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-6d72b3ba-adcf-4373-a3d6-3f284eaacab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:25.101635 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:19:25.143519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1453/2878] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:19:25.151130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cc441-3b4f-41a8-86db-12d2e6ec6201 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:25.151423 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cc441-3b4f-41a8-86db-12d2e6ec6201 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:25.151704 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1cc441-3b4f-41a8-86db-12d2e6ec6201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:25.171229 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9c1cc441-3b4f-41a8-86db-12d2e6ec6201 None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:19:25.172472 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9c1cc441-3b4f-41a8-86db-12d2e6ec6201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:25.180359 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1426/2879] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:19:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:19:25.184680 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b3ba-adcf-4373-a3d6-3f284eaacab9 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:25.194859 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d72b3ba-adcf-4373-a3d6-3f284eaacab9 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:25.199496 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce56524-f1f5-4581-8876-b8851012366a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:25.200321 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce56524-f1f5-4581-8876-b8851012366a admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:25.200843 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce56524-f1f5-4581-8876-b8851012366a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:25.201129 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce56524-f1f5-4581-8876-b8851012366a admin admin] PATH_INFO: `/v3/domains` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:25.201869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce56524-f1f5-4581-8876-b8851012366a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80418) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 20 22:19:25.202179 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce56524-f1f5-4581-8876-b8851012366a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:25.203779 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce56524-f1f5-4581-8876-b8851012366a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:25.216082 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1454/2880] 10.222.0.85 () {58 vars in 1152 bytes} [Wed Jul 20 22:19:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 20 22:19:25.220541 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cc441-3b4f-41a8-86db-12d2e6ec6201 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:25.229723 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1cc441-3b4f-41a8-86db-12d2e6ec6201 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:25.234447 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55c7e-2fcb-4003-9875-d5259f316e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:25.235086 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55c7e-2fcb-4003-9875-d5259f316e1a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:25.235369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55c7e-2fcb-4003-9875-d5259f316e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:25.235642 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc55c7e-2fcb-4003-9875-d5259f316e1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:25.236358 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55c7e-2fcb-4003-9875-d5259f316e1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:25.238259 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc55c7e-2fcb-4003-9875-d5259f316e1a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:25.348744 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1427/2881] 10.222.0.85 () {60 vars in 1152 bytes} [Wed Jul 20 22:19:25 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:19:25.352758 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce56524-f1f5-4581-8876-b8851012366a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:25.363277 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce56524-f1f5-4581-8876-b8851012366a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:25.421045 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0ba2f-0696-492e-991b-9ae9fa840f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:25.421834 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0ba2f-0696-492e-991b-9ae9fa840f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:25.422127 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0ba2f-0696-492e-991b-9ae9fa840f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:25.422401 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc0ba2f-0696-492e-991b-9ae9fa840f50 admin admin] PATH_INFO: `/v3/users` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:25.423085 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0ba2f-0696-492e-991b-9ae9fa840f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:25.425031 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc0ba2f-0696-492e-991b-9ae9fa840f50 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:25.523911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1455/2882] 10.222.0.85 () {60 vars in 1143 bytes} [Wed Jul 20 22:19:25 2022] POST /identity/v3/users => generated 295 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 20 22:19:25.529011 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55c7e-2fcb-4003-9875-d5259f316e1a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:25.539388 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc55c7e-2fcb-4003-9875-d5259f316e1a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:25.544658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19e2bc-fa6b-4bb2-8107-53b423f44143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:25.545319 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19e2bc-fa6b-4bb2-8107-53b423f44143 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:25.545604 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19e2bc-fa6b-4bb2-8107-53b423f44143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:25.545883 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19e2bc-fa6b-4bb2-8107-53b423f44143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:25.546611 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19e2bc-fa6b-4bb2-8107-53b423f44143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:25.548278 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea19e2bc-fa6b-4bb2-8107-53b423f44143 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:25.558835 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1428/2883] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:19:25.563175 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0ba2f-0696-492e-991b-9ae9fa840f50 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:25.573292 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc0ba2f-0696-492e-991b-9ae9fa840f50 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:25.578672 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c9074-f5f1-4d66-991c-7a4ef0b8c019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:25.579482 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c9074-f5f1-4d66-991c-7a4ef0b8c019 admin admin] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:25.579765 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c9074-f5f1-4d66-991c-7a4ef0b8c019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:25.580108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c9074-f5f1-4d66-991c-7a4ef0b8c019 admin admin] PATH_INFO: `/v3/roles` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:25.580869 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c9074-f5f1-4d66-991c-7a4ef0b8c019 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:25.582491 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34c9074-f5f1-4d66-991c-7a4ef0b8c019 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:25.593802 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1456/2884] 10.222.0.85 () {58 vars in 1121 bytes} [Wed Jul 20 22:19:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 20 22:19:25.598082 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19e2bc-fa6b-4bb2-8107-53b423f44143 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:25.608133 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19e2bc-fa6b-4bb2-8107-53b423f44143 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:25.612754 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645e9c4-191a-4507-b781-31b8ab789284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:25.613618 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645e9c4-191a-4507-b781-31b8ab789284 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:25.613899 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645e9c4-191a-4507-b781-31b8ab789284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:25.614172 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645e9c4-191a-4507-b781-31b8ab789284 admin admin] PATH_INFO: `/v3/projects/52ff52250b684353903240d50819a22e/users/6120e0d6669d473eb9d874da58abc316/roles/36dde009f57f45dd9ded880f26a9b2cc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:25.628829 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645e9c4-191a-4507-b781-31b8ab789284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ff52250b684353903240d50819a22e, user_id=6120e0d6669d473eb9d874da58abc316, role_id=36dde009f57f45dd9ded880f26a9b2cc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:25.631470 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c645e9c4-191a-4507-b781-31b8ab789284 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:25.699048 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1429/2885] 10.222.0.85 () {60 vars in 1482 bytes} [Wed Jul 20 22:19:25 2022] PUT /identity/v3/projects/52ff52250b684353903240d50819a22e/users/6120e0d6669d473eb9d874da58abc316/roles/36dde009f57f45dd9ded880f26a9b2cc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:19:25.710866 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af618bc2-913b-41e9-a7b3-086616ae3636 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:25.711358 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af618bc2-913b-41e9-a7b3-086616ae3636 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:25.711675 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af618bc2-913b-41e9-a7b3-086616ae3636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:25.739466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-af618bc2-913b-41e9-a7b3-086616ae3636 None None] MFA Rules not processed for user `6120e0d6669d473eb9d874da58abc316`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:19:25.740632 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-af618bc2-913b-41e9-a7b3-086616ae3636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:25.804453 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1457/2886] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:19:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:19:25.816937 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645e9c4-191a-4507-b781-31b8ab789284 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:25.818634 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c645e9c4-191a-4507-b781-31b8ab789284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:25.841502 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:19:25.876421 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645e9c4-191a-4507-b781-31b8ab789284 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:25.880038 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254dfbfd-b8d7-4245-b26c-21a5eba71853 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7153a137b4734df1a057d26509d53dd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:25.880681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dfbfd-b8d7-4245-b26c-21a5eba71853 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:25.880967 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dfbfd-b8d7-4245-b26c-21a5eba71853 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:25.881244 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254dfbfd-b8d7-4245-b26c-21a5eba71853 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:25.891849 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dfbfd-b8d7-4245-b26c-21a5eba71853 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:25.893323 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254dfbfd-b8d7-4245-b26c-21a5eba71853 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:25.902248 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1430/2887] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:19:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:19:35.801589 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:19:36.296338 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=17 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:19:37.505089 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af618bc2-913b-41e9-a7b3-086616ae3636 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:37.582183 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af618bc2-913b-41e9-a7b3-086616ae3636 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:37.586827 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:37.587713 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:37.588021 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:37.588455 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] PATH_INFO: `/v3/users/6120e0d6669d473eb9d874da58abc316` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:37.589774 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6120e0d6669d473eb9d874da58abc316)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:37.591945 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:37.772530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6120e0d6669d473eb9d874da58abc316'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:37.861135 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6120e0d6669d473eb9d874da58abc316'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:37.872061 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6120e0d6669d473eb9d874da58abc316'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:37.872848 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6120e0d6669d473eb9d874da58abc316'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:37.898200 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6120e0d6669d473eb9d874da58abc316'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:37.925906 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1458/2888] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:19:37 2022] DELETE /identity/v3/users/6120e0d6669d473eb9d874da58abc316 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:19:37.930749 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d29bb-d331-4c03-b005-ddbc7533a72f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:37.931258 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d29bb-d331-4c03-b005-ddbc7533a72f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:37.931369 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d29bb-d331-4c03-b005-ddbc7533a72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:37.956144 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-856d29bb-d331-4c03-b005-ddbc7533a72f None None] MFA Rules not processed for user `b412ad98326b4f4489e43e1f01737fef`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:19:37.957429 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-856d29bb-d331-4c03-b005-ddbc7533a72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:38.036051 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1431/2889] 10.222.0.85 () {58 vars in 957 bytes} [Wed Jul 20 22:19:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:19:38.047605 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:38.049764 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:38.125477 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886378b2-3956-4005-9961-4305e836ad0a admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:38.129227 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886efc-d5c7-403a-b973-964ac00c4f8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:38.129883 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886efc-d5c7-403a-b973-964ac00c4f8a service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:38.130166 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886efc-d5c7-403a-b973-964ac00c4f8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:38.130448 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886efc-d5c7-403a-b973-964ac00c4f8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:38.142132 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9886efc-d5c7-403a-b973-964ac00c4f8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:38.143663 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9886efc-d5c7-403a-b973-964ac00c4f8a service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:38.155406 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1459/2890] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:19:38.605772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d29bb-d331-4c03-b005-ddbc7533a72f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:38.608032 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-856d29bb-d331-4c03-b005-ddbc7533a72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:38.630367 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d29bb-d331-4c03-b005-ddbc7533a72f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:38.635993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:38.638132 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:38.638702 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:38.639162 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] PATH_INFO: `/v3/projects/52ff52250b684353903240d50819a22e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:38.643730 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ff52250b684353903240d50819a22e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:38.647491 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:38.794239 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ff52250b684353903240d50819a22e', 'request_id': 'req-5ac2a506-0499-4978-b8e0-0bff0dc731bc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:38.799938 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ff52250b684353903240d50819a22e', 'request_id': 'req-5ac2a506-0499-4978-b8e0-0bff0dc731bc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:38.957772 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ff52250b684353903240d50819a22e', 'request_id': 'req-5ac2a506-0499-4978-b8e0-0bff0dc731bc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:38.970299 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] The token cache is being invalidate because project 52ff52250b684353903240d50819a22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:19:38.970591 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:38.971563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:38.973335 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1432/2891] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:19:38 2022] DELETE /identity/v3/projects/52ff52250b684353903240d50819a22e => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:19:44.621762 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49908432-1ee0-46b6-b86e-c04fefee0063 None None] REQUEST_METHOD: `POST` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:44.622252 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49908432-1ee0-46b6-b86e-c04fefee0063 None None] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:44.622358 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49908432-1ee0-46b6-b86e-c04fefee0063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:44.641254 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.auth.core [None req-49908432-1ee0-46b6-b86e-c04fefee0063 None None] MFA Rules not processed for user `864f16bb01df4ea3866ed68b7f0eb0da`. Rule list: `[]` (Enabled: `True`). {{(pid=80418) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 20 22:19:44.642467 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-49908432-1ee0-46b6-b86e-c04fefee0063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:44.659875 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:19:44.699039 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1460/2892] 10.222.0.85 () {58 vars in 967 bytes} [Wed Jul 20 22:19:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 20 22:19:44.739892 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:44.741321 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:44.810508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac2a506-0499-4978-b8e0-0bff0dc731bc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:44.815468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b972f-3fad-4ead-bac1-aeaadd6ed750 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dff5a11076ea426a8bf760bfee7a5023', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:44.816158 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b972f-3fad-4ead-bac1-aeaadd6ed750 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:44.816466 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b972f-3fad-4ead-bac1-aeaadd6ed750 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:44.816739 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b972f-3fad-4ead-bac1-aeaadd6ed750 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:44.825595 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b972f-3fad-4ead-bac1-aeaadd6ed750 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:44.827184 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b972f-3fad-4ead-bac1-aeaadd6ed750 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:44.835098 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1433/2893] 10.222.0.85 () {60 vars in 1384 bytes} [Wed Jul 20 22:19:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 20 22:19:52.006647 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49908432-1ee0-46b6-b86e-c04fefee0063 None None] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:52.008872 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-49908432-1ee0-46b6-b86e-c04fefee0063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:52.088108 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49908432-1ee0-46b6-b86e-c04fefee0063 None None] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:52.093564 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b5ea7-f5b0-4817-a592-59cacc4fc86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:52.094233 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5ea7-f5b0-4817-a592-59cacc4fc86e service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:52.094560 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5ea7-f5b0-4817-a592-59cacc4fc86e service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:52.094835 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b5ea7-f5b0-4817-a592-59cacc4fc86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:52.097921 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-9b3b5ea7-f5b0-4817-a592-59cacc4fc86e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:52.203432 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b5ea7-f5b0-4817-a592-59cacc4fc86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:52.205062 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b5ea7-f5b0-4817-a592-59cacc4fc86e service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:52.218797 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1461/2894] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:19:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:19:53.014234 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b972f-3fad-4ead-bac1-aeaadd6ed750 service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:53.015746 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-da4b972f-3fad-4ead-bac1-aeaadd6ed750 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:53.032142 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:19:53.082116 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b972f-3fad-4ead-bac1-aeaadd6ed750 service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:53.086678 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:53.087544 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:53.087836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:53.088127 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] PATH_INFO: `/v3/users/9a34c34832ea44a7bec9ec48eddeebf0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:53.089312 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a34c34832ea44a7bec9ec48eddeebf0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:53.091836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:53.289046 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a34c34832ea44a7bec9ec48eddeebf0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:53.301264 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a34c34832ea44a7bec9ec48eddeebf0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:53.308233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a34c34832ea44a7bec9ec48eddeebf0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:53.309561 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a34c34832ea44a7bec9ec48eddeebf0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:53.310216 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a34c34832ea44a7bec9ec48eddeebf0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:53.408545 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1434/2895] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:19:53 2022] DELETE /identity/v3/users/9a34c34832ea44a7bec9ec48eddeebf0 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:19:53.656182 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b5ea7-f5b0-4817-a592-59cacc4fc86e service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:53.667674 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b5ea7-f5b0-4817-a592-59cacc4fc86e service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:53.708088 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:53.709528 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:53.735139 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:53.736122 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:53.736404 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:53.736676 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] PATH_INFO: `/v3/projects/d172279fa80e49738ced353d676cc750` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:53.737856 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d172279fa80e49738ced353d676cc750)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:53.739735 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:53.750897 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=100 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:19:53.770950 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8509c00e-18a8-4884-9332-e39b62f307a6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:53.774641 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6139fbd-f626-48e4-8891-918717124ca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:53.775309 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6139fbd-f626-48e4-8891-918717124ca3 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:53.775595 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6139fbd-f626-48e4-8891-918717124ca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:53.775873 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6139fbd-f626-48e4-8891-918717124ca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:53.777703 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d6139fbd-f626-48e4-8891-918717124ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:53.824777 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:19:53.850292 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6139fbd-f626-48e4-8891-918717124ca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:53.851752 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6139fbd-f626-48e4-8891-918717124ca3 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:53.862100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd172279fa80e49738ced353d676cc750', 'request_id': 'req-a329687c-304a-4e1b-a36e-8ed737c734b1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:53.864302 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1435/2896] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:19:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:19:53.868330 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd172279fa80e49738ced353d676cc750', 'request_id': 'req-a329687c-304a-4e1b-a36e-8ed737c734b1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:53.952157 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd172279fa80e49738ced353d676cc750', 'request_id': 'req-a329687c-304a-4e1b-a36e-8ed737c734b1'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:53.970987 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] The token cache is being invalidate because project d172279fa80e49738ced353d676cc750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:19:53.971282 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:53.972016 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:53.973854 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1462/2897] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:19:53 2022] DELETE /identity/v3/projects/d172279fa80e49738ced353d676cc750 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:19:53.977904 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6139fbd-f626-48e4-8891-918717124ca3 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:53.980303 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d6139fbd-f626-48e4-8891-918717124ca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:53.994808 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6139fbd-f626-48e4-8891-918717124ca3 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:54.052922 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:54.053794 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:54.054076 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:54.054352 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] PATH_INFO: `/v3/users/e3003f0bbaa8416bb6e8a1c95d4efde2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:54.055562 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3003f0bbaa8416bb6e8a1c95d4efde2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:54.057535 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:54.233958 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3003f0bbaa8416bb6e8a1c95d4efde2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:54.245935 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3003f0bbaa8416bb6e8a1c95d4efde2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:54.253495 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3003f0bbaa8416bb6e8a1c95d4efde2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:54.254176 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3003f0bbaa8416bb6e8a1c95d4efde2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:54.254784 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3003f0bbaa8416bb6e8a1c95d4efde2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:54.322419 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1436/2898] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:19:53 2022] DELETE /identity/v3/users/e3003f0bbaa8416bb6e8a1c95d4efde2 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:19:54.570393 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:19:54.572042 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:19:54.585884 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329687c-304a-4e1b-a36e-8ed737c734b1 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:19:54.645777 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:19:54.646667 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:19:54.646948 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:19:54.647265 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] PATH_INFO: `/v3/projects/232bda803f124d80a6b1438bc0cbdf52` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:19:54.648452 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232bda803f124d80a6b1438bc0cbdf52)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:19:54.650397 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:19:54.757878 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232bda803f124d80a6b1438bc0cbdf52', 'request_id': 'req-41efdf69-e15d-4285-bcf6-d712d2376570'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:54.764221 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232bda803f124d80a6b1438bc0cbdf52', 'request_id': 'req-41efdf69-e15d-4285-bcf6-d712d2376570'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:54.840737 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232bda803f124d80a6b1438bc0cbdf52', 'request_id': 'req-41efdf69-e15d-4285-bcf6-d712d2376570'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:54.852423 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] The token cache is being invalidate because project 232bda803f124d80a6b1438bc0cbdf52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:19:54.852711 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:54.853344 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:19:54.854879 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1463/2899] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:19:54 2022] DELETE /identity/v3/projects/232bda803f124d80a6b1438bc0cbdf52 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:20:04.318755 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=65,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:20:04.849386 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=71,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:20:06.427953 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:20:06.429527 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:20:06.490665 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61807ff4-f04f-463f-a0d5-108cd0292382 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:20:06.560601 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbeac80-4673-4302-96c3-2272ffdfc73f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:20:06.561252 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbeac80-4673-4302-96c3-2272ffdfc73f service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:20:06.561536 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbeac80-4673-4302-96c3-2272ffdfc73f service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:20:06.561815 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbeac80-4673-4302-96c3-2272ffdfc73f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:20:06.563681 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1cbeac80-4673-4302-96c3-2272ffdfc73f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:20:06.573516 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbeac80-4673-4302-96c3-2272ffdfc73f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:20:06.574998 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbeac80-4673-4302-96c3-2272ffdfc73f service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:20:06.583392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1437/2900] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:20:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 20 22:20:06.655046 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:20:06.656703 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:20:06.671003 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efdf69-e15d-4285-bcf6-d712d2376570 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:20:06.675347 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d108bb-32b8-4119-b5fb-0da52a83da49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:20:06.676023 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d108bb-32b8-4119-b5fb-0da52a83da49 service neutron] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:20:06.676304 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d108bb-32b8-4119-b5fb-0da52a83da49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:20:06.676576 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d108bb-32b8-4119-b5fb-0da52a83da49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:20:06.678346 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b4d108bb-32b8-4119-b5fb-0da52a83da49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:20:06.752516 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d108bb-32b8-4119-b5fb-0da52a83da49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:20:06.753978 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d108bb-32b8-4119-b5fb-0da52a83da49 service neutron] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:20:06.766171 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1464/2901] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:20:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:20:16.579468 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=46 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:20:16.761761 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=34 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:21:01.301572 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbeac80-4673-4302-96c3-2272ffdfc73f service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:21:01.303106 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1cbeac80-4673-4302-96c3-2272ffdfc73f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:21:01.313583 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbeac80-4673-4302-96c3-2272ffdfc73f service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:21:01.317164 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7475dc-8b0f-429b-a6b8-5d2c367b92b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ad07969d5a043e7b83e403da35120da', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:21:01.317793 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7475dc-8b0f-429b-a6b8-5d2c367b92b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:21:01.318073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7475dc-8b0f-429b-a6b8-5d2c367b92b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:21:01.318343 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7475dc-8b0f-429b-a6b8-5d2c367b92b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:21:01.320073 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9c7475dc-8b0f-429b-a6b8-5d2c367b92b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:21:01.329563 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7475dc-8b0f-429b-a6b8-5d2c367b92b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:21:01.330976 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7475dc-8b0f-429b-a6b8-5d2c367b92b0 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:21:01.338952 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1438/2902] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:21:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:21:11.335344 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:21:30.337575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d108bb-32b8-4119-b5fb-0da52a83da49 service neutron] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:21:30.337575 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-b4d108bb-32b8-4119-b5fb-0da52a83da49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:21:30.350239 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d108bb-32b8-4119-b5fb-0da52a83da49 service neutron] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:21:30.357611 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b445540-eb9c-4df2-838d-a67943e8adb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192a50b09b49b4b7db2508ecf75af5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'ResellerAdmin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:21:30.358261 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b445540-eb9c-4df2-838d-a67943e8adb9 service nova] REQUEST_METHOD: `GET` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:21:30.359029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b445540-eb9c-4df2-838d-a67943e8adb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:21:30.359029 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b445540-eb9c-4df2-838d-a67943e8adb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:21:30.360707 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-1b445540-eb9c-4df2-838d-a67943e8adb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:21:30.373911 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b445540-eb9c-4df2-838d-a67943e8adb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:21:30.375813 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b445540-eb9c-4df2-838d-a67943e8adb9 service nova] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:21:30.399234 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1465/2903] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:21:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:21:40.385749 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=6 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:21:43.053508 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7475dc-8b0f-429b-a6b8-5d2c367b92b0 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:21:43.054993 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9c7475dc-8b0f-429b-a6b8-5d2c367b92b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:21:43.122919 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7475dc-8b0f-429b-a6b8-5d2c367b92b0 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:21:43.127492 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:21:43.128392 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:21:43.128676 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:21:43.128948 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] PATH_INFO: `/v3/users/2d4d46c5076148c7b30364e67c16070d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:21:43.130149 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4d46c5076148c7b30364e67c16070d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:21:43.132143 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:21:43.301047 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4d46c5076148c7b30364e67c16070d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:43.312857 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4d46c5076148c7b30364e67c16070d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:43.319607 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4d46c5076148c7b30364e67c16070d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:43.320311 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4d46c5076148c7b30364e67c16070d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:43.320923 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4d46c5076148c7b30364e67c16070d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:43.401425 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1439/2904] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:21:43 2022] DELETE /identity/v3/users/2d4d46c5076148c7b30364e67c16070d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:21:43.648279 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b445540-eb9c-4df2-838d-a67943e8adb9 service nova] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:21:43.660636 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b445540-eb9c-4df2-838d-a67943e8adb9 service nova] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:21:43.721243 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:21:43.722100 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:21:43.722377 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:21:43.722649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] PATH_INFO: `/v3/projects/ac0e203ee82947e3a91b5f8f128a8406` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:21:43.723804 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac0e203ee82947e3a91b5f8f128a8406)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:21:43.725709 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:21:43.853146 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac0e203ee82947e3a91b5f8f128a8406', 'request_id': 'req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:43.858679 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac0e203ee82947e3a91b5f8f128a8406', 'request_id': 'req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:43.950071 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac0e203ee82947e3a91b5f8f128a8406', 'request_id': 'req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:43.964242 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] The token cache is being invalidate because project ac0e203ee82947e3a91b5f8f128a8406 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:21:43.964530 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:43.969159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:43.969159 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1466/2905] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:21:43 2022] DELETE /identity/v3/projects/ac0e203ee82947e3a91b5f8f128a8406 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:21:43.970803 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:21:43.972342 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:21:43.986233 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616412b1-a3ce-41fe-b038-b12e07b5dd2a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:21:44.043683 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:21:44.044844 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:21:44.045130 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:21:44.046150 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] PATH_INFO: `/v3/users/1e93266d3d234508984ee176513108b8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:21:44.047843 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e93266d3d234508984ee176513108b8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:21:44.049833 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:21:44.072249 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:21:44.289181 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e93266d3d234508984ee176513108b8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:44.304057 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e93266d3d234508984ee176513108b8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:44.311070 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e93266d3d234508984ee176513108b8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:44.315836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e93266d3d234508984ee176513108b8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:44.315836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e93266d3d234508984ee176513108b8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:44.424173 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1440/2906] 10.222.0.85 () {58 vars in 1223 bytes} [Wed Jul 20 22:21:43 2022] DELETE /identity/v3/users/1e93266d3d234508984ee176513108b8 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 20 22:21:44.683905 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] Authenticating user token {{(pid=80418) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:21:44.685444 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.fernet_utils [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80418) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:21:44.699649 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb65d-c4a8-4347-8dc1-d9d90ee583a5 admin admin] Validating token access rules against request {{(pid=80418) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:21:44.758915 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b412ad98326b4f4489e43e1f01737fef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e58c029bf3c74b4692bf7afb2155976a', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80418) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:21:44.759772 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:21:44.760079 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:21:44.760351 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] PATH_INFO: `/v3/projects/b5464c5e3fcf4784b3a596da01e630a7` {{(pid=80418) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:21:44.761519 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5464c5e3fcf4784b3a596da01e630a7)` {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:21:44.763409 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] RBAC: Authorization granted {{(pid=80418) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:21:44.865050 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:21:44.877466 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5464c5e3fcf4784b3a596da01e630a7', 'request_id': 'req-91fa94fb-d876-433b-9548-2d690ed6dd49'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:44.883248 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5464c5e3fcf4784b3a596da01e630a7', 'request_id': 'req-91fa94fb-d876-433b-9548-2d690ed6dd49'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:44.967241 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5464c5e3fcf4784b3a596da01e630a7', 'request_id': 'req-91fa94fb-d876-433b-9548-2d690ed6dd49'} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:44.979086 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] The token cache is being invalidate because project b5464c5e3fcf4784b3a596da01e630a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80418) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 20 22:21:44.979372 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:44.980084 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG keystone.notifications [None req-91fa94fb-d876-433b-9548-2d690ed6dd49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80418) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 20 22:21:44.981622 dv-cinder-849690-5-smb devstack@keystone.service[80418]: [pid: 80418|app: 0|req: 1467/2907] 10.222.0.85 () {58 vars in 1232 bytes} [Wed Jul 20 22:21:44 2022] DELETE /identity/v3/projects/b5464c5e3fcf4784b3a596da01e630a7 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 20 22:21:54.419250 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:21:55.068625 dv-cinder-849690-5-smb devstack@keystone.service[80418]: DEBUG dbcounter [-] [80418] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80418) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 20 22:23:01.324875 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 20 22:23:01.326767 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:23:01.397753 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc3968c-b883-4c5f-9090-bc2ab588ce52 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 20 22:23:01.458616 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33df53-58c3-40d3-914d-f4801827af6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e52a3464d8f4a3fa16a102336a4bbf6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '72c7456d6a30482f975028cab1d346f6', 'project_domain_id': 'default', 'roles': ['member', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 20 22:23:01.459269 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33df53-58c3-40d3-914d-f4801827af6d service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 20 22:23:01.459556 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33df53-58c3-40d3-914d-f4801827af6d service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 20 22:23:01.459836 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33df53-58c3-40d3-914d-f4801827af6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 20 22:23:01.461662 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3a33df53-58c3-40d3-914d-f4801827af6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 20 22:23:01.473415 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33df53-58c3-40d3-914d-f4801827af6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 20 22:23:01.474997 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33df53-58c3-40d3-914d-f4801827af6d service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 20 22:23:01.486148 dv-cinder-849690-5-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1441/2908] 10.222.0.85 () {60 vars in 1365 bytes} [Wed Jul 20 22:23:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 20 22:23:11.480658 dv-cinder-849690-5-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=58 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}